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Abstract 



In this paper we study a Gaussian relay-interference network, in which relay (helper) nodes are to 
facilitate competing information flows over a wireless network. We focus on a two-stage relay-interference 
network where there are weak cross-links, causing the networks to behave like a chain of Z Gaussian 

q _ channels. For these Gaussian ZZ and ZS networks, we establish an approximate characterization of 

the rate region. The outer bounds to the capacity region are established using genie-aided techniques 

£> ■ that yield bounds sharper than the traditional cut-set outer bounds. For the inner bound of the ZZ 

network, we propose a new interference management scheme, termed interference neutralization, which 

O. 

iy-\ , without the transmitters having complete access the interfering signals. For both the ZZ and ZS networks, 



we establish a new network decomposition technique that (approximately) achieves the capacity region. 
We use insights gained from an exact characterization of the corresponding linear deterministic version 
of the problems, in order to establish the approximate characterization for Gaussian networks. 

I. Introduction 

The multi-commodity flow problem, where multiple independent unicast sessions need to share net- 
work resources, can be solved efficiently over graphs using linear programming techniques H). This 
is not the case for wireless networks, where the broadcast and superposition nature of the wireless 
medium introduces complex signal interactions between the competing flows. The simplest example is 
the one-hop interference channel Q, where two transmitters with independent messages are attempting 
to communicate with their respective receivers over the wireless transmission medium. Even for this 
simple one-hop network, the information-theoretic characterization has been open for several decades. To 
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Fig. 1. Two-stage relay-interference network. 

study more general networks, there is a clear need to understand and develop sophisticated interference 
management techniques. 

The capacity of the wireless Gaussian interference channel has been (approximately) characterized, 
within one bit (see (3J and the references therein). Building on this progress, a natural next step is 
to study the approximate capacity region of small-scale interference-relay networks, where there are 
potentially multiple hops from the sources to destinations through cooperating relays. Studying even 
simple two-hop topologies could help develop techniques and build insight that would enable a (perhaps 
approximate) characterization of capacity for more general networks. We are interested in our work in a 
universal type of approximation, in that it should characterize the capacity to within a constant number 
of bits, independently of the signal-to-noise ratio and the channel parameter values. 

The focus of this paper is to study the two-stage relay-interference network illustrated in Figure [TJ In 
particular, we give an approximate characterization of the capacity region for special cases of these net- 
works when some of the cross-links are weak. These are illustrated in Figure |3(a)| and Figure |4(a)[ which 
we refer to as the ZS and ZZ Gaussian models. We first study a deterministic version of these problems 
by using the linear deterministic model introduced in BJ. An exact capacity region characterization in 
the deterministic case is then translated into a universally approximate characterization for the (noisy) 
Gaussian network. In particular, for ZS and ZZ networks we have a capacity region characterization 
within 2 bits (or less), independent of the operating signal-to-noise ratio and the channel parameters. 

In studying these special networks, we discover that many sophisticated techniques are required to 
(approximately) characterize the network capacity region. The main new ingredients that enable this 
characterization are as follows: (i) a new interference management technique we term interference 
neutralization, in which interference is canceled over the air, without the relays necessarily decoding the 
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transmitted message^; (N) a structured lattice code that enables interference neutralization over Gaussian 
networks; (iii) A network decomposition technique which enables appropriate rate-splitting of the message 
and power allocation for the different message components; (iv) genie-aided outer bounding techniques 
that enable bounds that are tighter than the information-theoretic cut-set outer bounds. 

A way to interpret the achievability results for the ZS networks is that the relays perform a partial- 
decoding of strategically split messages from the sources, and then cooperate to deliver the required 
messages to the destination, again through strategically splitting the messages. The power allocated to 
each of the sub-messages is determined using the insight derived from the deterministic model, that 
messages that are not intended be decoded arrive at the noise-level. The achievability for the ZZ network 
is slightly more sophisticated in that one of the relays is required to only decode a function of the sub- 
messages. The function is chosen such that its signal in combination with the transmission of the other 
relay causes the unwanted interference to be cancelled (neutralized) at the destination. This interference 
neutralization is enabled in the Gaussian channel using the group property of a structured lattice code. 

Work in the literature over the past decade has examined scaling laws for multiple independent flows 
over wireless networks, see for example (H-lUl. The goal there is to characterize the order of the wireless 
network capacity as the network size grows. In contrast, in our work, instead of seeking order arguments 
and scaling laws, we try to characterize the capacity (perhaps within a universal constant of a few 
bits) for specific topologies. The interference channel is a special case of such networks, where there 
is only one-hop communication between the sources and destinations. There has been a surge of recent 
work on this topic including cooperating destinations O and use of feedback in inducing cooperation 
at the transmitters ifTOl . The deterministic approach developed in (H has been successfully applied to 
the interference channel in ifTTTl . The fundamental role of interference alignment in if -user interference 
channel (still a one-hop network) has been demonstrated in lfT2l . lfT3l . 

The paper is organized as follows. Section [TT] introduces our notation and the basic network models we 
study. Section [III] illustrates the transmission techniques used in this paper through simple deterministic 
examples. The main results are given in Section QE1 along with a proof outline for the Gaussian networks 
in Section El The achievability and converse for the deterministic ZS network is given in Section EH and 
many of these ideas are translated into the precise proof for the corresponding Gaussian ZS network in 

'A noise nulling technique is proposed in (5) to mitigate correlated noise in an amplify-forward relaying strategy for a single 
unicast "diamond" parallel relay network. However, the difference in our technique is that we use the structure of the codebooks 
(without necessarily decoding information) to neutralize interference, and not noise statistics. Moreover the multiple-unicast 
nature of the problem necessitates strategic partitioning and rate-splitting of different components of the messages. 
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Appendix lAl Section IVIII follows a similar program for the ZZ network, by first identifying the capacity 
region for the deterministic version. This allows illustration of ideas such as interference neutralization, 
as well as genie-aided outer bounding techniques. The precise translation of these results into Gaussian 
ZZ networks is given in Appendix |B] Section IVIIII concludes the paper with a short discussion. 

II. Problem Statement 

A well accepted model for wireless communication is a linear Gaussian model. In this, the received 
signal yi(t) at time t, is related to the transmitted signals {»_/[£]} as 



Vi 



[t] = ^2hijXj[t] + z i [t] ) (1) 



where Zi(t) is i.i.d. (unit-variance) Gaussian noise, and hij represents the fading channel from transmitter 
i to receiver j. 

Ill The Deterministic Model 

In 0|, a deterministic model was proposed, to capture the essence of wireless interaction described 
in (Q]). The advantage of the deterministic model is its simplicity, which allows exact characterizations; 
its purpose is to build insights for the noisy wireless network in (Q]). The deterministic model of [|4l 
simplifies the wireless interaction model by eliminating the noise and discretizing the channel gains 
through a binary expansion of q bits. Therefore, the received signal Yi, which is a binary vector of size 
q, is modeled as 

Y l [t] = Y J N l] X J [tl (2) 

3 

where Nij is a q x q binary matrix representing the (discretized) channel transformation between nodes 
j and i and X is a q x 1 vector that contains the (discretized) transmitted signal. We will drop the time 
index t when it does not play a role for simplicity. All operations in © are done over the binary field, 
F2. We use the terminology deterministic wireless network when the signal interaction model is governed 
by ©. The model in (f2]) is an approximate representation of a Gaussian fading channel, which attempts 
to capture the attenuation effect of the signal caused by the channel gain. This can be interpreted as the 
number of significant bits of a binary representation of the input, Xj , that is above the noise level. More 
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precisely, typically the model in Q assigns Nij = 3 g ni \ where J is a shift matrix, i.e., 

/ ••• \ 
10 •■• 
1 ••• 



\o 



(3) 



o / 



qxq 



For real channel gain hij in the Gaussian model (0Q), we calculate riy as mj = \h log |/iy| 2 ~|. The 
parameter q is chosen such that q > maxjjfi log |/iy| 2 ]. 

An example of a deterministic network is illustrated in Figure [2] Each node contains several channel 
inputs and outputs, which are called sub-node or level through out this paper. Source S\ can only send 
one bit to node A and no bit to node B; source S 2 can send its two MSB to both A and B, and its LSB 
to node B. The transmitted bits from nodes Si and S2 interfere on the LSB that node A receives. 




Fig. 2. A deterministic network. 

In a deterministic network, given a cut that separates nodes U from node V, the cut-value equals the 
rank of the transfer matrix between the nodes in U and V. For example, in Figure El the cut that separates 
nodes U = {Si,S 2 ,A,B} and V = {D 1 ,D 2 } equals 

/ 1 \ 

10 

10 

\ 1 1 / 

The rows of this transfer matrix correspond to the four transmitted inputs by nodes A and B, while the 
columns to the four receives outputs at nodes Di and D 2 . 



rank 



3. 



(4) 



11.2 Interference-relay network model 

Our goal in this paper is to derive approximate capacity characterizations for a class of 2-user relay- 
interference networks shown in Figure [Q which we call the XX network. We start by describing our 
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notation for Gaussian channels. 

Two transmitters, 5i and 52, encode their messages W\ and W 2 of rates R\ and R 2 , respectively, and 
broadcast the obtained signals to the relay nodes, A and B. Denote the transmitted signals by x\ and 
X2, and the received signals at the relays by y' x and y 2 . Then 

yiM = \fgiixi[t] + Vmx2[t] + z[[t], 



(5) 

2/2 M = y/92lXl[t] + y/g22X 2 [t] + z' 2 [t], 

where z[,z' 2 are unit-variance Gaussian noises, independent of each other and of x\,x 2 . 

The relay nodes perform any (causal) processing on their received signal sequences {yi[t]} and {y 2 [t]} 
respectively, to obtain their transmitting signal sequences, {x[(t)} and {x 2 (t}}. The received signals at 
the destination nodes can be written as 

Vi[t] = Vh^x[[t] + Vh^x' 2 [t] + zi[t] 



(6) 

2/2 [t] = Vh^x'^t] + Vh^x' 2 [t] + z 2 [t), 

where the z[, z 2 , z\, and Z2 are independent zero-mean unit- variance noises, which are also independent 
of x\ and x-i. There is a power constraint for each transmitted signal, that is, E[xf] < 1, lEfx^] < 1, 
E[xf] < 1 and E[x' 2 2 } < 1. 

Each destination node Di, i = 1,2, is interested in decoding its message W%, using its received signals 
{yj[t]}. We define a rate pair (Ri, R2) to be admissible if there exist a transmission scheme under which 
D\ and D2 can decode W\ and W2, respectively, with arbitrary small (average) error probability in the 
standard manner [14]. This would allow two end-to-end reliable unicast sessions at rates (Ri,R 2 ) for 
the source/destination pairs (Si,Di) and (52,I?2)- 

A useful tool to examine the network problem defined above is to study its deterministic version, based 
on the model developed in ©. Using the deterministic approach, we can rewrite (H)-© as 

Y{[t] = M 11 X 1 [t} + M 12 X 2 [t} 
Y 2 ^t] = M2 1 X 1 [t} + M22X 2 [t}, 
and 

Y 1 [t] = N 11 X[[t] + N 12 X' 2 [t] 

(o) 

Y 2 [t]=N 21 X[[t)+N 22 X 2 [t], 



where the matrices {Mij} and {Nij} approximately model the channels in ©-Q, i.e., My = Ji- m 'i , TVy = 
jq-n i:j _ -p^g maa -j x j j s defined as in ©, while rriij = |"i log \gij\ 2 ] and riij = \\ log |/iy| 2 ]. 

It is worth mentioning that though this network looks like cascaded interference channels, there is an 
important difference. Unlike the interference channel, the messages sent by the relays at the second layer 
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of transmission need not independent, i.e., we can try to induce cooperation at the relays to transmit 
information to the final destinations. This distinction makes this network more interesting than a simple 
cascade of interference channels. 

In this paper, we focus on two specific realizations of the network, namely, the ZS and the ZZ networks, 
which further simplify the connectivity models of (f5])-([6l). We describe these two networks in the following, 
and give an approximate characterization of their admissible rate region in Section [TV] 
Notation alert: Throughout this paper, we use the lowercase letters x and y for the signals transmitted 
by the sources and received signals at the destinations in the Gaussian networks. The received and 
transmitting signals by the relays are denoted by x' and y' . Similarly, uppercase letters will be used for 
the deterministic networks. 



II. 3 The ZS Network 

The ZS network is a special case of the interference -relay network defined in ©-(16]). In the ZS network 
one cross link in each layer has a negligible gain, and therefore does not cause interference, as illustrated 



in Figure 3(a) In particular, we assume #21 = ^12 = in the Gaussian network, and 77121 = ^12 = in the 



deterministic network. The resulting Gaussian ZS network is shown in Figure [3(a)! and the deterministic 
model for this network is given in Figure |3(b)| 




Fig. 3. The ZS network. 
May 5, 2010 



(a) The Gaussian ZS network 
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(b) The deterministic ZS network 
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II.4 The ZZ Network 

The ZZ network is another special configuration interference-relay network, wherein one cross link 
in each layer has zero gain. However, the difference is that, here the missing links are in parallel. In 
particular, we assume 1721 = hl\ = and 77121 = "-21 = in the Gaussian and deterministic networks, 
respectively. The Gaussian and corresponding deterministic ZZ networks are shown in Figure 01 



' A * rrr- Dl 




j B x 2 Vh^ J D2 

4 



(a) The Gaussian ZZ network 

S JX, mn n j X[ m ^j^ 




Fig. 4. The ZZ network. 



(b) The deterministic ZZ network 



III. Examples illustrating transmission techniques 

In this section, we illustrate through examples some of the main interference management techniques 
we will use to (approximately) achieve the capacity of our relay-interference networks. For simplicity in 
demonstrating the ideas, we focus on deterministic networks throughout the examples. However, similar 
techniques will be used later for Gaussian channels as well. 

We also present a simple Gaussian example at the end of this section, to illustrate the message splitting 
idea used in many places through out this work. 

Example 1 (Network Decomposition for the ZS Network): A deterministic ZS network can be always 
decomposed into two subnode-disjoint networks, where the first partition consists of a set of sub-nodes 
of Si, A and D\, and looks like a line network. The second partition is, however, a diamond network, 
with a broadcast channel from S2 to A and B in the first layer, and a multiple access channel from A 
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and B to D2 in the second layer. This diamond network can be used to send information from S2 to D<i- 
Since these two networks are sub-node disjoint, there would be no interfering signal, and each of them 
can be analyzed separately. This is more illustrated in Figure [5J 




Fig. 5. Network partitioning for a deterministic ZS network. 

In a Gaussian ZS network the network decomposition can be done using message splitting, superposi- 
tion coding and proper power allocation. We will use this technique to achieve an approximate capacity 
for the Gaussian ZS network. 

Example 2 (Interference Neutralization): This technique can be used in networks which contain more 
than one disjoint path from Si to Dj for i ^ j, where Dj is not interested in decoding the message sent 
by the source node Si, and therefore it receives the interference through more than one link. The proposed 
technique is to tune these interfering signals such that they neutralize each other at the destination node. 
In words, the interfering signal should be received at the same power level and with different sign such 
that the effective interference, obtained by adding them, occupies a smaller number of degrees of freedom. 
To best of our knowledge, this technique is new and was been introduced in ITT31 . 




Fig. 6. Interference Neutralization; (Ri,R,2) — (2,2) is achievable. 
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Fig. 7. Interference neutralization. 



Figure [6] shows a network in which interference neutralization is essential to achieve the desired rate 
pair (i?i,i? 2 ) = (2,3). Here D\ has only two degrees of freedom, and receives information bits from 
both A and B over these sub-nodes. However, notice that there are two disjoint paths (S2,A,Di) an d 
(52, B, D\), which connect S*2 to D\, As it is shown in Figure [6] using a proper mapping (permutation) 
at the relay nodes, one can make the interference neutralized at the destination node D\, and provide 
two non-interfered links from S\ to D2. Note that this permutation does not effect the admissible rate of 
the other unicast from S2 to D2, the cost we pay, is to permute the received bits at Z>2- A more general 
illustration of this phenomenon is given in Figure [7] 

Example 3 (Use of Lattice Codes to Implement Interference Neutralization over Gaussian ZZ Network): 
The idea of interference neutralization illustrated in Example [2] can be also used in Gaussian networks. 
In this case a group structured code, such as lattice code, is required to play the role of composition 
and decomposition of the signal and interference in two layers of the network. Consider the Gaussian 



ZZ network in Figure |4(a)| We can use message splitting and interference neutralization to improve the 
achievable rate pairs of this network. 

Let the second source split its message into two parts as W2 = (W 2 , W 2 ), namely, the functional 
(neutralization) and private parts, of rates R,2,n = -Ri and R,2,p = R2 — R\- Both transmitters use a 

common lattice code to encode W\ and W 2 , and map them into x^ and x 2 , respectively. The 

(P) (P) 

other message W 2 can be encoded to x 2 ' using a random Gaussian code. We assume that both the 

lattice code and the random Gaussian code have average power equal to 1. Then, the transmitting signals 

would be a linear combination of the codewords with a proper power allocation, i.e., 

x 2 = y/fhhJp + ^x 2 P) , (9) 



Xl 



/ W 
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where the power allocation coefficients satisfy a at < 1 and (3^ + (5p < 1. The transmitters choose the 
power allocated to x^ to x 2 in a way that they get received at A with the same power. In this way, 
their summation would be again a lattice code and can be decoded at A by treating x^ ' as noise. A 
similar strategy will be used for signaling at the relay for transmission in the second layer of the network. 
The only difference is that instead of sending Xr, , the relay node B sends — Xr, . Then, the lattice point 
observed at D\ would be exactly x^ and it can find W\. The other decoder can simply first reverse 



r (N) 



r (N) 



x 2 to x 2 , and then decode it. This idea is illustrated in Figure [8] 



/ W 
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Fig. 8. Using lattice codes for interference neutralization over a Gaussian ZZ network. The origin is specified by a cross "x". 
Power allocated to the messages at the transmitters are chosen such that the two lattice points corresponding to x[ and Xj 
get received at B at the same power level, and their summation becomes a point on the scaled lattice. The same strategy is used 
by the relays. The relay node B also reverses its transmitting lattice point in order to neutralize the interference caused in the 
first layer of the network. 

Example 4: Consider the Gaussian Z network shown in Figure |£l with channel gains g\\ > 1, gu > 1, 

and £22 > 1- 




Fig. 9. A Gaussian Z network. 

The source nodes F{ wishes to encode and send message Wi to the destination node Gj, for % = 1, 2. 
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Denoting the rate of message W{ by Ri, an approximate capacity characterization for this network is 
given by network is given by 



TZ z = {(R 1 ,R 2 ):R 1 <^log(l+g u ] 



J R 2 <^log(l + <?22) (10) 

R x + R 2 <^log(l + < ? ii + <7i 2 ) + ^log(l + ^ > ) }. 

It is easy to show that any achievable rate pair belongs to TZ Z , and hence 1Z Z establishes an outer bound 
for the capacity region. Moreover, one can show that the rate pair (R\ — ~ , R 2 — \ ) is achievable provided 
that (Ri, R 2 ) G 1Z Z . The encoding strategy to achieve such rate pair involves message splitting and proper 
power allocation. We will discuss this in more details in Appendix O 

IV. Main Results 

In this section we present the main results of this paper, which is the approximate capacity character- 
ization of the Gaussian ZS and ZZ interference -relay networks. In order to obtain such an approximate 
characterization, we have a complete characterization of the deterministic versions of the ZS and ZZ 
networks. The coding strategies for the Gaussian problems are outlined in Section [V] The detailed 
analysis of these strategies and the corresponding outer bounds which lead to Theorems [2] and [4] are 
given in Appendices |A] and EJ respectively. Most of the insights are obtained by analyzing the deter- 
ministic versions of these problems, and the exact characterizations are summarized in Theorems Q] and 
[3] respectively. We prove these results in Sections [VI] and I VII I respectively. The achievability and outer 
bound results for the Gaussian cases are directly inspired by these results. 

IV.l The ZS Network 

The ZS network illustrated in Figure |3(b)| and the corresponding Gaussian ZS network is given in 
Figure |3(a)| Theorems Q] and |2] give the exact and approximate (within 2 bits) characterizations of their 



capacity regions. 

Theorem 1 (The capacity region of deterministic ZS network): The capacity region of the determinis- 
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tic ZS network is specified by 1Z DZS , where 1Z DZS is the set of all rate pairs (R\,R 2 ) that satisfy 

Ri < mn, (DZS-1) 

R 2 < max(mi 2 ,m 22 ), (DZS-2) 

Ri + R 2 < max(mii,mi 2 ) + (m 2 2 - mi 2 ) + , (DZS-3) 

i? 2 <mi 2 +n 2 2, (DZS-4) 

Ri + i? 2 < m 2 2 +max(nn,n2i), (DZS-5) 

Ri + R 2 < max(mn,mi2) + n 2 2, (DZS-6) 

fli < nn, (DZS-7) 

R 2 < max(n 2 i,n 2 2), (DZS-8) 

R2<m 22 +n 21 , (DZS-9) 

-Ri + -R2 < max(n 2 i, n 2 2) + (nn - n 2 i) + . (DZS-10) 

Theorem 2 (An Approximate capacity region of Gaussian ZS network): Let TZ be the set of all 
rate pairs (R\,R 2 ) which satisfy (|GZS-lb — (IGZS-lOb given below. Then 7Z GZS is an outer bound for 
the capacity region of the Gaussian ZS network. Moreover, for any (R\,R 2 ) G 1Z GZS , there exists a 
transmission scheme with rates (R[, R' 2 ) = (Ri — 5\,R 2 — 5 2 ), where 5\ = 1 and 5 2 = 1.5 are universal 
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constants, independent of the channel gain, and required rates. 

#i<^iog(i + <m) (Gzs-i) 

R2< ^\og{l + g l2 + g 22 ) (GZS-2) 

R 1+ R 2 <\ log(l + 911 + g 12 ) + \ log ( 1 + ^ (GZS-3) 

^2 < ^ !og(l + 912) + 2 log(l + M (GZS-4) 

i?i + R2 < 2 log(l + 922) + 2 log(l + /in + M (GZS-5) 

#1 + R2 < 2 log(l + ffn + 512) + 2 lo g(! + M (GZS-6) 

#1 < ^ log(l + hu) (GZS-7) 

^2 < -log(l + /i 2 i +/122 + 2^/h2~J^) (GZS-8) 

i?2 < - log(l + 922) + 2 log(l + h 21 ) (GZS-9) 

i?i + R2 < \ log(l + /121 + /122 + 2y/h 21 h 22 ) + ^ log f 1 + ^ J . (GZS-10) 



The outer bound for the results above are fairly standard arguments based on reducing a multi- 
letter mutual information into single-letter forms by appropriately using decodability requirements at 
the different destinations. The details of these are given in Section |VI. 11 and Appendix IB. 1[ respectively. 

The coding strategy achieving these regions is based on two ideas. One is that of a network decompo- 
sition illustrated in Section Hill Example [Q for the deterministic network. The insight from the network 
decomposition leads to the idea of strategic rate-splitting and power allocation in the Gaussian channel. 
For the Gaussian coding scheme, we need to strategically partition the messages and allocate powers in 
order for the relays to partially decode appropriate messages and setup cooperation. The details of this 
strategy are outlined in Section IVl 

IV.2 The ZZ Network 

The ZZ network illustrated in Figure |4(b)| and the corresponding Gaussian ZZ network is given in 
Figure |4(a)| Although superficially the ZS and ZZ networks may look similar, the subtle difference 
in the network connectivity, makes the two problems completely different, both in terms of capacity 
characterization, as well as transmission schemes. It will be shown that a new interference management 
scheme, which we term as interference neutralization, is needed to (approximately) achieve the capacity 
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of this network. The most intuitive description for interference neutralization is to cancel interference 
over air without processing at the destinations. This scheme can be used whenever there are more than 
one path for interference to get received at a destination. We will explain it in more detail in Sections |Vl 
andlVlTl 

Theorems [3] and |4] give the exact and approximate (within 2 bits) characterizations for the capacity 
region of the deterministic and the Gaussian ZZ networks, respectively. Another new ingredien used here 
is needed a genie-aided outer bound that gives the (noisy) cross link of the first (or correspondingly 
second) layer to the destination (or correspondingly to the relay). This genie-aided bound allows us to 
develop outer bounds that are apparently tighter than the information-theoretic cut-set bounds by utilizing 
the decoding structure needed. 

Theorem 3 (The capacity region of deterministic ZZ network): The capacity region of the determinis- 
tic ZZ network is given by VP ZZ , where 1Z DZZ is the set of all rate pairs (R\, R 2 ) which satisfy 

Ri < m n , (DZZ-1) 

R 2 < m 22 , (DZZ-2) 

R x < n u , (DZZ-3) 

R 2 < n 22 , (DZZ-4) 

Ri+r 2 < max(mn, mi 2 ) + (m 22 - mi 2 ) + + n\ 2 , (DZZ-5) 

R\ + R 2 < max(nn, ni 2 ) + (n 22 - n\ 2 ) + + mi 2 . (DZZ-6) 

Theorem 4 (An approximate capacity region of Gaussian ZZ network): Let 1Z GZZ be the set of all rate 
pairs (R\,R 2 ) which satisfy (IGZZlb — dGZZ6b given below. 

fli<ilog(l + (/ii) (GZZl) 

#2<^log(l + <?22) (GZZ2) 

i?i<^log(l + /in) (GZZ3) 

R 2 < ilog(l + h 22 ) (GZZ4) 

Ri + R 2 <\ log(l + <7n + 912) + \ log ( 1 + —) + \ log(l + h 12 ), (GZZ5) 

2 2 \ 512/ 2 

Ri + R 2 < I log(l + /in + h 12 ) + I log (l + ^ ) + J log(l + 512) (GZZ6) 

z Z \ h\ 2 J I 
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Then, any admissible rate pair (R±,R2) for the Gaussian ZZ networks belongs to 1Z QZZ . Moreover, for 
any rate pair (i?i, ife) € 1Z GZZ , there exists an encoding scheme with rates (if^, i? 2 ) = (Ri — \, R2 — \)- 

V. Gaussian coding strategies 

This section is devoted to providing the basic ideas of the coding schemes used in the Gaussian ZS 
and ZZ networks. We also develop an outline of how to analyze these coding strategies. 

V.l The Gaussian ZS network: Achievability 

The coding strategy for the Gaussian ZS network is essentially a partial-decode-and-forward strategy, 
along with a strategic rate-splitting of the messages. Let the messages to be sent from S\, S2 be denoted 
by Wi, W2 respectively (see Figure [3(a)] ). We will break the ZS network into two cascaded interference 
channels, where we require particular messages to be decoded at the relays and forwarded to the 
destinations. The first stage is a Z interference channel, where the message W2 is split into three parts: 
( f/ 2 1^2 1 ^2 ) ■ The intention of this strategic split is to allow the the node G\ (which is relay A in 
the original ZS network) to decode (U± , [7 2 ,U^ ) and node G2 (which is relay B in the original ZS 
network), to decode ( [/ 2 ,U^ )■ This is illustrated in Figure [10] Here, J7 2 plays the role of a common 



(2) (3) 

message which can be decoded at both receivers, whereas [T^ and C/ 2 are the private messages for 

G\ and G2 respectively. 

The next stage of the ZS network is a S interference channel depicted in Figure [TTJ Here we take the 
messages delivered and decoded by the Z interference channel of the first stage and further process them 
to ensure delivery of the desired messages to the destination. In particular, we further split the decoded 
messages from the first stage into several parts and require delivery of messages as shown in Figure [TTJ 
This splitting and delivery of appropriate pieces, finally ensures that W\ and W2 are decodable at the 
destinations. This is the encoding strategy in the ZS network. In the following lemmas, we give the rates 
at which messages at each stage can be delivered. Putting together Lemmas [JJ and [2l we get the desired 
result given in Theorem [2 The proofs of these lemmas follow fairly standard arguments, and are given 
in Appendix ICl 

A formal statement of the argument above is given below. 

Lemma 1: Consider the Gaussian Z interference network with channel gains (911,912,922), and de- 
coding requirements as shown in Figure [TO] Denoting the rate of the sub-message U( by Tjj, any rate 
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Fig. 10. The Z interference channel with particular message requirements, captures the proposed coding scheme for the first 
layer of the Gaussian ZS network. 



tuple (Tn,T2,i,T 2j 2,T2,3) which satisfies 



(ilog(l+0n)-i 



T 2 , 2 5 ( I lc 



912 \ 1 



922/ 2 

T 2 ,i ^ T 2j2 < ( I log (1 + fifi 2 ) - - 



Ti,i + T 2) i + T 2j2 < ( - log (1 + 9n + g i2 ) - - 



T 2 , 3 < ( I lc 



912 



T 2 ,i ^ T 2j3 < ( - log (1 + g 22 ) - - 



(7) 

(8) 

(9) 

(10) 

(11) 
(12) 



is achievable. 

The next lemma gives an achievable rate region for the second layer of the ZS network, which is a S 
interference network depicted in Figure [TTJ 
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Fig. 11. The S interference channel with particular message requirements, depicting the proposed coding strategy for the second 
layer of the Gaussian ZS network. 
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Lemma 2: Consider the Gaussian S interference network with channel gains (/in, /i 2 i, /122), and 
decoding requirements as shown in Figure [TT] where 0jj denotes the rate of message V i . Any rate 
tuple (0i,i, G lj2 , 02,i, @2,2> ©2,3, ©2,4) ©2,5) which satisfies 

©1,1 + ©1,2 + ©2,1 + ©2,3 < Q log (1 + /ill)" ^ , (13) 

e -^G-( i+ £)4) + ' 

©1,1 + ©2,3 + ©2,4 < Q log (1 + h 21 ) - ^ , (16) 

©2,5 < Qlog(l + / l22 )-0 , (17) 

©1,1 +©2,1 +@2,2 + @2,3 + ©2,4 + ©2,5 < Q log (l + /l21+/l 22 )- ^J , (18) 

is achievable. 

V.2 The Gaussian ZZ network: Achievability 

The encoding scheme needed for the ZZ network is slightly more sophisticated than the ZS network. 
An additional component to strategic message splitting is that of interference neutralization. This was 
illustrated in examples |2] and [3] in Section JII] This along with message splitting inspired by the network 
decomposition illustrated in example Q] of Section JIIJ form the basis of the encoding scheme for the ZZ 
network. 

More formally, the interference that has to be neutralized, will be combined with the main message in 
the first layer according to some partial-invertible function. In the second layer the inverse of the function 
is applied on this combination and the other interference received through the cross link. The remaining 
parts of the interference has to be either decoded or treated as noise. The neutralization is implemented 
using lattice codes and the rate-splitting along with appropriate power allocation is also used. 

We formally define a partial-invertible function and a Z-neutralization network in the following. The 
Gaussian ZZ network is essentially a cascade of two Z-neutralization networks. An achievable rate region 
for the Z-neutralization network is given in Lemma [3] This rate region will be later used to obtain an 
achievable rate region for the Gaussian ZZ network. We will analyze the performance of the Gaussian 
encoding/decoding schemes in Appendix IB.2I 
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Definition 1: Let U and V be two finite sets. A function <p(-, •) defined on U x V is called partial- 
invertible, if and only if having <p(u, v) and u, one can always reconstruct v for any u £lA and v G V. 
Similarly, u can be obtained from 0(u, u) and i>. 

An intuitive way of thinking about a partial-invertible 0(it, v) is the following. An arbitrary function 
defined on a finite sets U and V creates a table with rows corresponding to the elements of U and 
columns corresponding to the elements of V, the each cell of the table consists the value assigned to its 
row and column by the function. A function will be partial-invertible, if and only if no two cells in the 
same column or row of its table be identical. 

Note that summation over real numbers, and multiplication over non-zero numbers are two examples of 
partial-invertible functions. However, it is clear multiplication over real numbers is not partial-invertible, 
since w = 0(1, 0) = 0(2, 0), and therefore having w and v = 0, u can be anything. 

Definition 2: Consider the Z network shown in Fig[T2j which consists of a Gaussian broadcast channel 
from i<2 to the receivers and a Gaussian multiple access channel from F\ and F2 to G\ . A Z-neutralization 



(o) TT (i)\ v^i V9ii A _Jiy (f T W i (T M T m 



t/w 17W) y ^i v^i,^ __^y {u\ L, A{ur^>) 







~2 



Fig. 12. The Gaussian Z channel. 



network is a Z network, wherein the first source node has two messages (l/[ , U{ ) of rates To and 
Ti, respectively. Similarly the second source observes two independent messages (?7 2 ,U^ ) of rates 
T and T 2 . 

The second receiver is interested in decoding L^ and [7 2 , while the first destination wishes to 
decode <p(U{ , J7 2 ) and U{ , where 0(-, •) can be any arbitrary partial-invertible function. A rate tuple 
(To,Ti,T2) is called achievable if the receivers can decode their messages with arbitrary small error 
probability. 

Lemma 3: Consider the Z-neutralization network defined Definition |2] with channel gains (gu , 512, 522) 
(see Figure IT2T >. Let 

X = mm{g 1 i,gi2,g22}, (19) 
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and 



912 



fi = max<gu,9i2,922, >■ (20) 



Any rate tuple (Tq,Ti,T2) satisfying 



T < Qlog(A)-£) , (21) 

T + Tx< Qlog( 5ll )-lJ , (22) 

To + T 2 <Qlog(0j 2 )-l) , (23) 

T + T 1 + T 2 < Q log (/,)-£) , (24) 

is achievable. 

As mentioned before, we strategically split the messages and require functional reconstructions for 
some of them at the relay nodes to facilitate neutralization at the destinations. More precisely, in the first 
layer of the network, each source node splits its message into two parts, namely, "functional" and private 
parts, W\ = (U^\U^A and W 2 = (u^, U^A. The "functional" parts u[ 0) , U^ 1 both have the same 
rates To- Both transmitters use a common lattice code to encode their functional sub-messages. Now the 
first layer encodes the message such that the first receiver (which is relay A in the original ZZ network) 
can decode U\_ and (j>(U\_ , t/ 2 ), and the second one (relay B in the original ZZ network) can decode 
U% and U% . Lemma [3] gives the rates at which these can be sent reliably. The second stage operates 
in a manner similar to the first stage, by splitting the messages into functional and private parts. The first 
sender (relay A in the original network) uses U\ and <fi(U{ ,11^ ) as the private and functional parts 
and the other one (relay B) uses C/" 2 and C/ 2 as the private and functional parts. 

The functional parts are sent appropriately, using a common lattice code in both stages. Let x^ and 
x 2 be the lattice codewords, corresponding to U\ and U^ , respectively. The power allocation In the 
first layer it is done so that two lattice points get received at A at the same power (see Figure [8]). The group 
structure of the lattice code implies that the summation of two received lattice point, x^ = x^ + x 2 
is still a valid codeword, and can be decoded by A. The function $>(•,•) is in fact the decoded message 
from x^). In the second stage, relay node B, sends the inverse of the the received lattice point, that 
is x 2 = — x 2 , while A forwards the sum lattice point, x x = x^ N \ Again these lattice points are 
scaled properly so that they get received at D\ at the same power. Thus, their summation would be a 
lattice point and equals x x + x 2 = (x^ + x 2 ) — x 2 = x^ , which will be decoded to U[ . 
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The other destination D2, receives — x 2 , finds its inverse x 2 , and finally decodes it to Jj\ . This 
idea is illustrated in Example [3l and the precise details of this argument are given in Appendix IB.2I 

VI. The Deterministic ZS Network 

In this section we prove Theorem [Q We study this problem in two parts. First we present the converse 
proof, which shows any achievable rate pair belongs to 1Z DZS . Then for any rate pair in this region, we 
propose an encoding scheme which is able to transmit messages up to the desired rates. 

VI. 1 The Outer Bound 

In this section we show that any achievable rate pair (R\, R2) for the deterministic ZS network belongs 
to 7Z DZS . Assume there exists a coding scheme with block length £ which can be used to communicate 
at rates R\ and R2 over the network. We use fold face matrices to denote £ copy of them, as the transfer 
matrix applied over a codeword of length i, e.g., Mn = It® M\\. 

All of the bounds in the theorem except (1DZS-3I ) and (IDZS-lQb can be obtained straight-forwardly 
using the generalized cut-set bound in |[T6l , which shows that in a linear finite-field network, the maximum 
reliable rate can be transmitted through a cut is upper bounded by the rank of the transition matrix of the 
cut. Here, we only present the proof of (IDZS-51 ) to illustrate this idea. Then we prove the two remaining 
bounds, which are tighter than the cut-set bound. 

(IDZS-51 ) R\ + i?2 < ?7t22 + max(nn, 71-21).' This bound corresponds to the cut Q, s = {S\,S2,A} 
and Qd = {B,Di,D2}. The transition matrix from the input of the cut Xq s = (X2,X[) to its output 
Yfi d = (Yg, Yi, Y2) can be written as 



" j? " 




M22 







" X* ] 







Y( 


— 





Nn 




x'l 


+ 





[yi \ 







N21 _ 








N22 



X?. 



(25) 



Therefore, from llT6l we have 

£{Ri + R 2 ) < rank(G^ si n d ) = rank(M 2 2) + rank 



Nn 
N 2 i 



£17122 +^max(nn,n2i). (26) 



As mentioned before, we skip the proof of those bounds which follow from the generalized cut-set 
bound. In the following we present the proof of the two remaining inequalities which are tighter that the 
cut-set bound. 
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(1DZS-3I ) R\ + R 2 < max(mn,mi2) + (777,22 — m-i 2 ) + - In order to prove this bound, we can start 
with 

£(Ri+R 2 )<I(XlX l 2 ;Y 1 e 1 Y 2 i ) 

<I(X(,X e 2 ;Y^X") 
= I{X{, X|; y x 7 ) + /(Xf , Xi- YftY'i) 
< I{Xi,Xi;Y?) + HOtflY?) - HOtflXlX&Y?), 
where in (|2VT > we used the data-processing inequality for the Markov chain 

(x(,xl) o (y;\y 2 £ ) o (x?, j#) ** (y/,yf), 

and (128T ) holds since Y 2 is function of X 2 . Now, it is clear that 



Mn M 2 i 



'max(mn, 77112) 



< -frank 



foank(Mi 2 )+- 



(27) 



(28) 



(29) 



(30) 



(31) 



(32) 



I(Xf,X^Y{) <rank 
In order to bound the second term, we can write 

H{Y 2 ^) = H{Y 2 i \Y[\x' 1 \Y() 

<H{Y 2 \W 2 \Y[\X'^Y[) 

= H{Y 2 1 \y[ 1 , X[ e , Y(, W 2 ) + H(W 2 \Y'£ 1 ,X' 1 i , Y( 

< H{Y 2 l \Y[\ X[\ Yl W 2 , X[) + £e e 
<H{Y 2 e \Y; l -M 11 x()+£s £ 

< H(M 22 X e 2 \M 12 X e 2 ) + £e e 

M 12 
M 22 

= £(m 22 -mi 2 ) + +£e e , 

where (l3Tb holds since X-y is also a function of Y x , and Y( is also a deterministic function of X/.. We 
used Fano's inequality in (l32l . where W\ should be decodable based on Yf . Summing up (l30b and (I33T ). 
we get the desired bound. 

Note that the cut-set bound for the cut Q s = {Si, S 2 } and Qj = {A, B, D\, D 2 } gives us 

Mn M12 
M 22 



(33) 



£(Ri + R 2 ) < rank 



£max(mn + 77722,77712) 



(34) 
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in which the RHS can be arbitrarily larger than the RHS of the presented bound. The reason for this 
difference is the following. It is inherently assumed in deriving the cut-set bound that the receivers can 
cooperate to decode the messages of rates Ri and R 2 , and no decodability requirement is posed for 
individual receivers. However, the setup of this problem impose an extra constraint, that is B alone 
should be able to decode W 2 . Incorporating this decodability requirement shrinks the set of admissible 
rates, and gives us a tighter bound. 

(IDZS-lOb R\ + R 2 < max(ri2i,riii) + (ran — n2\) + : The last inequality captures the maximum 
flow of information from the relays to the destinations, such that D\ and D2 be able to decode W\ and 
W 2 , respectively. We again start with 

i(Ri + R 2 ) < HXi, Xi- Yf, Yf) = H(Y{, Y 2 e ) = H(Yf) + H(Y<\Yi). 



The first term can be easily bounded by 

H{Y£) < rank 



!max(ra2i,ra 2 2)- 



N 2 i N 22 
In order to bound the second term, we use the fact that W 2 can be decoded from Y 2 . Therefore, 

H{Y(\Yi)<H{Y(,W 2 \Yi) 

= H(Yf\Yi,W 2 ) + H(W 2 \Yi) 

<H(Yf\Yi,W 2 ) + le e 

= H(Y(\Yl W 2 , Xi, Y 2 e , X' 2 l ) + te t 

<H(Y(\Yi-N 22 X 2 l ) + Ze t 

= H(N ll X' 1 e \N 21 X' 1 e ) + le e 

N u 
N21 



(35) 



(36) 



(37) 



< frank 



frank (JV 2 i) + 



i{nn -n 21 ) + +£e £ . 



(38) 



In (1371 ) we used the Fano's inequality, as well as the fact that X 2 , Y 2 , and X 2 are known having W 2 . 
The bound is obtained by replacing (l36l) and (l38l) in (l35l ). 

It is worth mentioning that this bound is tighter than the cut-set bound for the cut J7 S = {S±, 5*2 > A B} 
and Qd = {Di,D 2 }, which is 



Ri + R 2 < max(ran + n 22 ,ni 2 ). 



(39) 
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VI.2 The Achiev 'ability Part 

Network Decomposition:: The achievability scheme presented here is based on decomposition of 
the deterministic ZS network into two node-disjoint networks. In fact, such partitioning depends on the 
demanded rate pair (R±,R2) E TZ DZS . The resulting family of separations immediately suggests a simple 
coding scheme. We will show that this separation is optimal, and does not cause any loss in the admissible 
rate region of the network. 

Before introducing the network decomposition, we define an equivalence class for the sub-nodes (levels) 
in a network. 

Definition 3: In a Z (or S) deterministic network, two sub-nodes a and b are called related sub-nodes, 
and denoted by a ~ b if any of the following conditions hold: 

• a = b; 

• a is connected to b; 

• b is connected to a; 

• there exists a sub-node c such that c broadcasts to both a and b; 

• there exists a sub-node d where both a and b are connected to. 

Note that this relation is reflective, symmetric, and transitive. Therefore, it forms equivalence classes for 
the sub-nodes. 

We denote by J\f\ and A/2 the partitions of the network. Assume we wish transmitting at rate R\ = 
r < min(mii,nii) from Si to D\. The first part of the network J\f\, includes the top (mn — m\2) + 
levels as well as the lowest (r — (mu — mi2) + ) + levels of S±. It also includes all the related sub-nodes 
of S2, and the receiver levels of A and B. Similarly, in the second layer of the network, A/i includes the 
lowest (nn — ^2i) + levels as well as the top (r — (mi — ^2i) + ) + nodes of the transmitter part of A. 
All related sub-nodes of the transmitter part of B, as well as D\ and D2 also belong to A/i. The second 
part of the network A/2, is formed by all the remaining nodes. 

We will use A/i for transmitting data from Si to D\ . Similarly A/2 is only used to communicate from S2 
to Z?2- Therefore, we have two uni-cast networks, and each pair of transmitter-receiver can communicate 
up to the capacity of their own partition, which is the min-cut of the partition (4J. 

It is worth mentioning that any two "related" sub-nodes belong to the same partition. Therefore, these 
two networks are node-disjoint, and do not cause interference for each other. This allows us to derive 
the capacity of each network separately, and argue that {R\, R2) can be achieved simultaneously for the 
original network, if R\ and R2 are achievable for partitions A/i and A/2. 
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Encoding Scheme: A transmission from Si and S2 to Di and D2 is performed as follows. Si 
transmits only on its sub-nodes which belong to Mi, and keeps its other sub-nodes silent. Similarly, S2 
encodes its message on the sub-nodes included in A2, and sends zero on the other levels. Therefore, the 
effective communication over each partition is a simple uni-cast. 



SiJ^ r_^ 1 _jX 1 r _ ny^ 

A 

(a) Effective channel for (Si, Di). 

A 



(2) S7 v'( 2 ) 




X 2 m' 22 {r) B n ' 22 (r) Y2 

(b) Effective channel for (S^,^)- 
Fig. 13. The effective separated ZS network. 



Y#2 



Fig. [13] shows the effective parts of the network. It is easy to see that the diamond network in 
Figure |13(b)| is also a linear shift deterministic networks, with channel gains 

m/ 12 (r) = min(max(?nii, 77112) — f,mi2), (40) 

m 22( r ) = min(max(mn, 77712) + ("722 - m-i2) + - r, 77122), (41) 

n 2 i (r) = min(max(77n , n 2 i ) - r, n 2 i ) , (42) 

77 22 (r) = min(max(nn, n 2 i) + (n 2 2 - n 2 i) + - r, 77 22 ). (43) 

Achievable Rate Region: The cut values of Ai can be easily computed as 

^ = {Si} : (tTJh — 777i 2 ) + + (r — (77711 — "7i2) + ) + = max{ (77711 — "7i2) + , r} > r 

Q, = {Si, A} : (r- (nn - ™i2) + ) + + (mi - ni 2 ) + = max{(rcn - in 2 ) + ,r} > r. 

Therefore any rate in lZ® zs (r) = {Ri : Ri < r} can be conveyed from Si to Di through Ai. 

The capacity of A2 can be found using the generalized max-flow min-cut theorem J4). Hence, the rate 
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region of the second partition A/2 would be 

ft 2 DZS (r) = {R 2 :R 2 < max(m , 12 (r),m / 22 (r)), (44) 

R 2 <m' 22 (r)+n 21 (r), (45) 

R 2 <m' 12 (r)+n' 22 {r), (46) 

R 2 < max(n 21 (r),ra 22 (r))}. (47) 

Therefore, by using this decomposition, any rate pair in the set 1Z® zs (r) x 7^2 )ZS (r) = {(R±, R2) '■ Ri £ 
lZ® zs (r),R 2 G 7?.^ zs (r)} can be achieved. It remains to prove the following lemma. 
Lemma 4: For any deterministic ZS network, 

TZ DZS C \J (ll? zs (r)xK% ZS (r)). (48) 

r'<min(mii,nn) 

We will prove this lemma in Appendix O 

VII. The Deterministic ZZ Network 

In this section we prove Theorem[3] This is done in two parts, that provide the converse and achievability 
proofs. 

VII. 1 The Outer Bound 

In the following we will show that any achievable rate pair (Ri,R 2 ) satisfies constraints (IDZZ-lb - 
dDZZ-61 ). The individual rate bounds can be directly obtained by the generalized cut-set bound introduced 
in lfl6l . where the maximum flow of information through a cut in a linear deterministic network is upper 
bounded by the rank of the transition matrix from the sender part of the cut to its receiver part. Hence, 
we skip the proofs of (IDZZ-lb - (IDZZ-4b . 

The sum-rate bounds in dDZZ-5l )- dDZZ-6l ) are, however, genie-aided bounds which are tighter that the 
cut-set bounds. In the following, we focus on these two bounds, and present their proofs in detail. Again 
we assume that there exists a coding scheme with block length £ which can be used to communicate at 
rates R\ and R 2 over the network. 

dDZZ-51 ) R\ + R 2 < max(mn, mi 2 ) + (m 22 — mi 2 ) + + n\ 2 : In order to prove this inequality we 
focus on the flow of information from the sources to the relays. The key idea here is to provide A with 
the information sent by B to D\ as side information. In such condition, the information A has received 
about W\ is stronger than the information available at D\, and therefore A can decode W\ since D\ can 
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as well. Once W\ is decoded at A, it can determine the transmitted codeword from Si. By removing the 
interference from Si, A can also partially decode Wi. 
More precisely, we can write 

i(Ri + R2) < I(Xi,X e 2 ; Yi e , Y 2 e ) = H(Y; e , Y?) < H{Y[", Y 2 e , T e 2 ) 
= H{Y[\Ti) + H{Y 2 "\Y[ t ,Ti) 
< H{Y[ l ) + H(Ti) + H (Y?\Yl e , T e 2 ), (49) 

where Y 2 = Ni 2 X 2 is the part of the signal received at D 2 from B as in Figure |4(b)| The first two 
terms are easily bounded by £max(mn,mi2) and ln\ 2 , respectively. Deriving an upper bound for the 
last term is more involved. 

Similar to Tl 2 , we define T\ = ^s/ii 2 X 2 , where we have 

H(T[\Y[\Tl 2 ) = H(Y; e - M 11 X i 1 \Y^,Tl 2 ) (50) 

<H{X[\Y[\Yl 2 ) 

= H(w 1 \Y; e ,x' 1 e ,ri 2 ) 
<if(Wi|NnX^ + n 2 ) 

= H(Wi\Yh)<£e t , (51) 

where ee — > as £ grows. We have used the invertibility property of the deterministic multiple access 
channel in (l50b . and (T5Tb follows from the Fano's inequality, and the fact that D\ can decode the message 
sent by S\. Therefore, we have H(Tli\Y 1 ,1^2) < £se- Hence, 

H{Y 2 i \Y[\Tl 2 ) < H(Y; e ,Th\Yi e ,Tl 2 ) 

= H(Y2 e \rh,Yi e ,T 2 ) + H{Th\Y[\Tl 2 ) 
<H{Y 2 t \Tl l ) + £e, 
= H(M 22 Xl\M 12 Xl) + £e £ 

< l(m 22 - m 12 ) + + tee. (52) 

Replacing the upper bounds for each term in (l49l . we get 

R\ + Ri < max(mn,mi 2 ) + nyi + (m 2 2 - rrii 2 ) + . (53) 
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It is worth mentioning that the cut-set bound for Q s = {S\, S 2 } and 0^ = {A, B, D±, D 2 } gives us 

R\+ R 2 < max(?nn + m 2 2, mx 2 ), (54) 

which is looser than the genie-aided bound. 

(1DZZ-6I ) R1+R2 < max(nn,ni2) + (n22 — ni2) + +mi2-" The last inequality captures the maximum 
flow of information from the relays to the destinations. Intuitively, this inequality says that the number 
of interfering bits can get neutralized at D\ cannot exceed the minimum of m\i and n\ 2 . In order to 
make this intuition formal, we provide Y\\, the partial information about W2 which is available at A, as 
side information for D\. We then have 

i(Ri + R2) < I(Yh, Yl 2 ; Xh,Xl 2 ) = H(Yh,Yl 2 ) 

< H(Yh,Yl 2 ,Th) 

< H(Yh) + H(Th) + H(Yl 2 \Yh,Th). 

Again, we can simply upper bound the first two terms by the rank of the corresponding matrices. In 
order to bound the last term, similar to the proof of (1DZZ-5I ). we use the following bounding technique. 

H(Tl 2 \Yh,r{) = H(Yh - NuXflyfi.rZi) 

< H{X'l\Yh,Yh) 

< H(Yl e \Yl u Th) 

= H(M u Xh +Tl 1 \Yl 1 ,ri 1 ) 

< HiXhlYh^h) 

< H(Xh\Yh) 

<if(V^i|y/i)<fe£, (55) 

where (1551 ) follows from the Fano's inequality. This inequality can be used as 
H(Yl 2 \Yh,Th) < H(Yl 2 ,Tl 2 \Yh,Th) 

= H{Yl 2 \Tl 2 ,Yl 1 ,Tl 1 ) + H{Tl 2 \Yl 1 ,Tl 1 ) 

<H(Yl 2 \Tl 2 )+£e e 

= H(N 22 X 2 e \-N 12 X 2 e )+£e i 

< l(n 22 - n 12 )+ + le t . (56) 
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Therefore, we have 

R\ + R 2 < max(nn,ni2) + rn\ 2 + (n 22 - ni 2 ) + . (57) 

Again, it is easy to show that this bound is tighter than the cut-set bound for Q s = {Si,S2,A, B} and 
Q d = {D l3 D 2 }, 

R\ + R 2 < max(nn + n 22 ,ni 2 ). (58) 

This completes the proof of the converse part of Theorem [3] 

VII.2 The Achievability Proof 

In this part we will show that all rate pairs satisfying inequalities (IDZZ-lb - (IDZZ-6b are achievable. 
In particular, we introduce a coding scheme which achieves such rates. Our coding strategy provides 
the interference neutralization at the destination. This is performed by splitting the messages into two 
parts, namely private and functional parts. The private sub-messages can be decoded at the relays, and 
forwarded to the destinations. The functional sub-message of the second source can be also decoded at 
B. However, A only receives a combination (xor) of the functional sub-messages, and cannot decode 
them. It only forwards such combination on proper (power) levels such that the interference caused by the 
functional sub-message of 5 2 get neutralized over the second layer of the network, and D\ can decode 
the sub-message of its interest. 

Our analysis is based on characterizing the number of pure and combined bits can be sent through each 
layer of the network. In the following we focus on one layer of the network, and obtain an achievable 
rate region for these numbers. Next, we use this region to build the encoding scheme for the ZZ network, 
and obtain an achievable rate region, which matches with the outer bound. 

Definition 4: Consider a deterministic Z network, with gains (nu,ni 2 ,n 22 ). as shown in Figure [T4l 
Each of the transmitters has a set of information bits to transmit to the receivers. This set for F{ 
includes T, private bits and To functional bits, namely, Wi t p = {Wi t p(l), . . . , Wi t p(Ti)} and Wj,jv = 
{Wi^(l), . . . , -Xiiv(To)}. The second receiver wishes to receive all the private and functional bits of 
F 2 , while the first receiver is interested in receiving the private bits of F\, and the xor of the functional 
bits of F\ and F 2 . More precisely, denoting by VVj the set of bits Gi is interested in, we have 

m = Wi, P U {Wi,iv (i) = W hN (J) © W 2 ,n(J) ■ J = i, • • • , T o}, 
>V 2 = W 2 ,p U W 2 ,jv- 
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We term this network with the described decoding demands as deterministic Z-neutralization network. 
The goal is the characterize the set achievable tuples (To, Ti, T2). 



{W ltN (l),...,W ltN (T )} 
{Wi >P (l),...,Wi,p(Ti)} 

{W 2 , N (l),...,W 2iN (T )} 
{W r 2 l p(l),...,W 2 ,p(T 2 )} 




{Wi >N (l) © W 2 ,n(1), • • • , W llN (? ) © ^2,7v(T )} 
{Wi,p(1),...,W 1i p(Ti)} 

{W2,at(1),...,W2,jv(T )} 

{W 2t p(l),...,W 2tP (T 2 )} 



Fig. 14. A deterministic Z-neutralization network with the message demands. 

The following lemma gives an achievable rate region for the deterministic Z-neutralization network. 
The proof of this lemma can be found in Appendix O 

Lemma 5: Consider the deterministic Z-neutralization network defined in Definition @] with channel 
gains (nn, 7112,7122) (see Figure IT4b. Any rate tuple (Yo,Ti, Y2) satisfying 

Y < A = minjnii, m 2 , n 22 }, (59) 

T + Ti<mi, (60) 

Y + Y 2 < n 2 2, (61) 



Y + Yi + Y 2 < fi = max{nii,ni 2 ,n 22 ,nii + n 22 - n 12 }. 



(62) 



is achievable for this network. 

Now, having an achievable rate region for the deterministic Z-neutralization network, we are ready to 
present the coding scheme and analyze its rate region for the ZZ network. 

Recall that the ZZ network consists of two cascaded Z network. In first layer, the source nodes split 
their message into private and functional parts. They can send these parts to the relays as long as their 
rates belong to the achievable rate region of the first layer given in Lemma [5] Once the relays receive these 
sub-messages, forward them to the destination nodes using the same scheme for the private and functional 
sub-messages. This can be done if the rate tuple for the sub-messages satisfy the corresponding inequalities 
for the second layer as well. Note that functional bits received at the destination are Wi,n(J)®W 2 ^{J) = 
[Wi,tv0) © W2,n(J)] © W 2j n(J) = Wi,n(j). Therefore, the interference of these bits get neutralized, 
and pure information bits will be received at the destination. 
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The achievable rate region of this scheme is given by 

^ z = {(Ei,i?2):3T ,T 1 ,T 2 >0, 

Ri = To + Ti, 

R 2 = T + T 2 , 

T < min{A m ,A n }, 

To + Ti < min{mn,nii}, 

To + T 2 < min{m22,n.22}, 

T + Ti + T 2 < min{yu m , (i n }\ (63) 

Here we used subscripts m and n to denote A and \x parameters of the first and the second layer of 
the network, respectively. Applying Fourier-Motzkin elimination on this set to project it on the (Ri, R2) 
plane, gives us the rate region claimed in the theorem. 

VIII. Discussion 

Interference management is perhaps the most fundamental open problem in wireless networks. The 
recent progress in (approximate) characterization of the interference channel capacity and the utility of 
the deterministic approach inspired the questions studied in this paper. Even though the interference-relay 
networks studied in this work were special, they revealed several new features needed for information 
transmission. In particular, the interference neutralization and network flow decomposition techniques 
were uncovered through the study of ZZ and ZS networks. We also saw the importance of using structured 
lattice codes for interference neutralization. Moreover, we believe that the neutralization technique is 
robust to channel uncertainties and one could get partial neutralization in such situations. This is a topic 
of ongoing work on this topic. We also believe that the outer bounding techniques developed in this 
work could have more general applicability in the wireless multiple-unicast problem. The two-unicast 
problem in arbitrary layered wireless networks would be a natural next step arising out of our work. The 
deterministic approach for this problem has already provided some interesting new techniques fTTl . In 
summary we believe that the deterministic approach is a promising methodology to make progress on 
the wireless multiple-unicast problem. 
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Appendix A 
The Gaussian ZS Network 

A. 1 The Outer Bound 

In the following we will prove each of the inequalities in (IGZS-lb - (IGZS-10b . separately. We will use 
the notation as shown in Figure [[5l and assume that the rate pair (R\, R2) can be achieved with small 
enough decoding error probability using a code of length L 



(+) — - j x -© — - y 




Fig. 15. The Gaussian ZS network. 

Lemma 6: Any achievable rate pair (i?i,i?2) satisfies 

£R 1 <I(x{;y{)+£e i , 
£R 2 <I(x e 2 ;y e 2 ) + £e e , 
£(Ri + R2)<I(.x{,xi;y{,yi) + 



(A.l) 
(A.2) 
(A.3) 



Note that ei — > as £ grows. 

This lemma is a consequence of the Fano's lemma combined with the decodability requirements imposed 

by the problem, and its proof is given in Appendix 

Most of the inequalities in (1GZS-1I )- (1GZS-10I) are cut-set type bounds, although the proof presented 
here are slightly different than the standard argument. However, the sum-rate bounds in (IGZ5-3b and 
(IGZS-lOb are different from the well known cut-set bounds. These two bounds are in general tighter 
than the cut values for the corresponding cuts. This is because the decoders are inherently allowed to 
cooperate in deriving a cut-set bound, while individual decoding abilities are imposed in this problem. In 
the following we first present the proofs of (IGZS-3b and (1GZS-10I) . which are more involved, and then 
prove the cut-set type bounds. 
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a) The proofs of non-cut-set type bounds: 

(IGZS-31 ) Ri + R 2 < ^log(l + g u +g 12 ) + ^\og (l + |^J: We start with Lemma [6] for the sum-rate 

which implies 

£(Ri + R 2 ) < I(x{,xi;y{,yi) + £e e 

<I(4,4;Vi,V2)+tet (A-4) 

= i(x[ , 4; y'i) + i( x i, x i;y2\y'i) + fei 



< - log(l + 511 + gi 2 ) + h(y'£\y'f) - h{y 2 l \y(, x{,x l 2 ) + 



where (IA.4b follows from the data processing inequality. Now, note that 

Ky'lW^y'l) = Kvitib + HiW^vi) 

= H(W 1 \y' 1 e ) + h(y' 2 e \W l ,y' 1 e ) 

<^(Wi|yf) + %;Vi,2/i')- 
Therefore, 

Ky'i\y' 1 t )<h{yi\W ll y'l)+^ 

<h(y%\4,Vi)+tet 

= h(y' 2 e \x{, ^ffmxi + z() + £ei 

< Hy/g&xi + z 2 e \^/gj2~x e 2 + z() + £e e 



h(yfg22~x 2 + z 2 

\/ff22 



/ff22 
/ff!2 



(V5124 + 4 £ )I\/512 ;E 2 + z 'l) + ^ 



< h(z 2 



'912 



#)+■ 



922 



■log(27re) 1 + — ) +fe £ , 

912, 



(A.5) 



(A.6) 

(A.7) 



(A.8) 



where (IA.6I ) holds since xf is a function of W\, and in (IA.7I ) we used the invertibility property of 
the function y\ = ^/gy[x\ + ^/g\2X 2 + z(. Replacing h{y 2 \y() from (IA.8I ) in ( 1A.5D , we get the 
desired bound. 
(IGZ5-10b R x + R 2 <\ log (l + fc) + I log(l + h 21 + /i 2 2 + ^h 2l h 22 ): The sum-rate can be 
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upper bounded as in Lemma [6] Next, we have 

£(Ri + R 2 )<I(x{,xi;y i 1 ,y i 2 )+£s i 

<i{x'i,x'i;y[,yi)+tet 

= I(x'i, x'i; y l 2 ) + I(x 2 e ; y[\yi) + I(x'/; y{\x 2 e , y l 2 ) + ■ 
The first term in (IA.9b can be simply upper bounded as 



(A.9) 



I(x{, x 2 £ ; y l 2 ) < - log(l + h 21 + h 22 + 2^/h 21 h 22 ) 



(A. 10) 
In order to bound the second term, we can use the fact that W 2 can be decoded from y 2 , and write 

I(x 2 i -y{,W 2 \ y i) = I(x 2 e -, y {\y e 2 )+I(x 2 i -,W 2 \ y {, y i) 
= I(x' 2 i ;y{\W 2 ,y i 2 ) + I(x' 2 i ;W 2 \y i 2 ) 
< I{x 2 l ;y[\W 2 J 2 ) + H{W 2 \y{) 
<I{xi',^\^W 2 )+ie l . 
Therefore, 

i{*h v[\vi) < i(?h yflvi w 2 ) + fe* < i{y't y{\vi, w 2 ) + te t = £e e , (A.ii) 

where the second inequality follows from the fact that x 2 is a function of y' 2 , and (IA. lib holds 
since y' 2 and y\ are independent if W 2 is given. 
Finally, we bound the last term as follows. 

I(x'i; y{\x'£, yi) = I(x'{\ y[\x'£, y/fax'{ + 4) 

r i n '£ £\ '£ Hi '£ £\ r / t\ 'l Pi '£ £ ' £\ 

= h(y/hiix 1 +z 1 \x 2 , yh 2 ix 1 + z 2 ) - h(y 1 \x 2 , \/ h 21 x 1 + z 2 ,x 1 ) 



< h(yh\\Xi + z[ 
"2 l0g ( 1 + ^ 



rh x 



fh 



UVh^xl + Z £ 2 )) - h(z{) 



21 



(A. 12) 



Replacing the bound derived for the three terms, dA. 10b , dA. 1 11 ), and dA. 12b in dA.91 ), we get the 
desired bound. 



May 5, 2010 



DRAFT 



35 

b) The proofs of cut-set type bounds: 

(IGZS-lb R\ < \ log(l + g\\): We start by Lemma |6l and write 

m 1 =I{xi;y{)+£s e 

<I(4\y'{)+te t (A. 13) 

<I(4\^Vi)+tei 

= I(x{; x £ 2 ) + 7(4; y'{\4) + lei (A. 14) 

<-log(l + ffii)+fe/ (A.15) 

where (|A. 13b follows from the data-processing inequality for the Markov chain x\ -H- y'-[ -H- x( -H- 
2/j, and in (1A.14I) we used the fact that x\ and x\ are independent. It is worth mentioning that this 
inequality essentially bounds the maximum flow that can be transmitted through the cut £l s = {.Si} 
wAn d = {S 2 ,A,B,D u D 2 }. 
(IGZS-21 ) R 2 < \ log(l + g\ 2 + 522): Again starting from Lemma [6] we have 

m 2 <I(xi;yi)+ee i 

<I{4\Vi,V2)+tet (A.16) 

< I(xi;x{,y'l,y'l)+lei 

= 7(4; 4) + i(4\ y'i, v-i\4) + ^ 

= Ky'l,y'i\x[) - h(y'{,y£\4,4) + ie e 

< HVm4 + z'i, \fms4 + z 2 l ) - H z i, &i) + &t 

< -log(l + ffia + g 22 ) + lei, (A.17) 

where the data processing inequality implies (IA.16I ) for the Markov chain x\ <-> (y'i, y' 2 ) -H- 
(xi,x 2 ) -H- y[. Note that this bound is essentially the cut-set bound for the cut £l s = {S 2 } and 
Q d = {S 1 ,A,B,D 1 ,D 2 }. 
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(1GZS-4I ) R 2 < \ log(l + 312) + \ log(l + /122): Again we use Lemma [6] to upper bound R 2 as 

= I{x' 2 e , xi;x{) + I(x' 2 ', 4; ft*, y||xf ) + £e e 

= I{x 2 e , x l 2 ;y'(\x\) + I{x 2 e , x^\y l 2 \x{,y() + &1 

= I{xi;y'l\x\) + I(x' 2 e ;y' 1 e \x{,x e 2 ) + I{x£]y l 2 \x\,y'f) + I{x l 2 \y^\x[,y^xi) + £e e (A.18) 

= A x i\V\\ x i) +I(x' 2 i ;y e 2 \x{,y' 1 e ) + £e e 

(A. 19) 
Note that we used the fact that the second and fourth terms in dA.181 ) are zero. This follows from 



< - log(l + g 12 ) + - log(l + h 22 ) + £e e 



and 



I{x 2 t ;y{\x\,x t 2 ) < J(x 2 ;i/i - V9u x \ - s/g^x^x^x^) = I{xi;z{\x\,x%) = 

ji £ £\ £ '£ '£\ <?- t( (. £\ £ '(. '£\ 
* \ x 2i 2/2l x l' Vl ! x 2 ) — -* \ x 2i V2\ x \-: x \i x 2) 

^ ti I f H '{. Pi 'l\ £ '£ '£\ 

< I(x l 2 ;y 2 - \/h 21 Xi - \/h 22 x 2 \x\,x{,x 2 ) 

s- t( t i\ I '£ '£\ _ n 
-i J {X 2 , Z 2 \Xi, Xi , X 2 ) — U. 

(1GZS-5D R x + R 2 < \ log(l + g 2 2) + \ log(l + h u + h 21 ): 
We start from Lemma [6] and write 

e(Ri + R2)<i(y{,y i 2 ;x{,x t 2 )+t£t 
< I(y{,y2, x i, x i) + Zse 

= I{y 2 e ; xi) + I{y 2 e ; x'(\x l 2 ) + I(y{, y{;x'( : x l 2 \y 2 l ) + £e £ 

= I{y 2 e ; xi) + I(y{,yi, x'-f, x l 2 \x' 2 l ) + £e £ 

= I(y 2 ;x e 2 ) + h(y{,yi\x'i) - h{y[ : yl\x{,x'f \x' 2 e ) + £e e 

< I{y 2 e ; xi) + h{y/k^.x'l + z[, \fh2\xl + z l 2 ) - h(z{,z e 2 ) + £e e 



(A.20) 



£ £ 

< - log(l + 522 ) + - log(l + h n + h 21 ) + £ei 



(A.21) 
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where (1A.201 ) follows from the data processing inequality for the Markov chain (x{, x 2 ) -H- (y 1 , y' 2 ) -H- 
(cc/, a; 2 ) ^ (2/1 ^ 2/2)- Note that this bound essentially captures the maximum flow of information 
through the cut Q s = {Si, S 2 , A} and £l d = {B, D 1 ,D 2 }. 
(EZES Ri + R 2 < \ log(l + 511 + 9u) + \ log(l + h 22 ): 
Similar to the previous bounds, we start from Lemma [6] and write 

Ri + R2< I(y{,yi;x[,x e 2 ) + £e e 

<I{y'(,y i 2 ,x[,x i 2 )+£e l (A.22) 

< I{y'f,y l 2 ;x[,x l 2 ,x' 2 l ) + let 

= I(y[ e ;x{,xi) + I(y[ e -x 2 e \x{,xi) + I(yi;x 2 %[ £ ) + Iiy^xi^ily'^x'i) + £e e (A.23) 
= I(y'i; x{,x e 2 ) + I(y e 2 ; x'i\y'() + £e e 

< - log(l + 511 + 512) + I{yh x 2 \y'l) + lea. (A.24) 

Note that in dA.221 ) we used the data processing inequality. An argument similar to that is used in 
the proof of (1GZS-4I ) shows that the second and fourth terms in dA.231 ) are zero. Now, we have 

I{yhx 2 \y'i) = Ky l 2 \yl) - h{y l 2 \x 2 l ,y() 

< h{yi\x'() - h{yi\x'(,x'£,y'() 

= h(y/h2~2~x'i + z l 2 \x() - h{zi\x'(,x£,y'i) 

< h^s/h^x^ + z 2 ) - h{z 2 ) 

<^l og (l + /l22 ) (A.25) 

Finally, we obtain the desired bound by replacing dA.251 ) in dA.241 ). It is worth mentioning that this 
bound is the same as the cut-set bound for the cut Q s = {Si, S 2 , B} and O^ = {^4, D\, D 2 }. 
(IGZS-7b R\ < t; log(l + /in): Using Lemma [6] and the data processing inequality, we can write 

£R 1 < I(xf; y{) + £e e < I(x(; y[) + £e e < l - log(l + /in) + £e £ . (A.26) 

dGZS-81 ) R 2 < \ log(l + h 2 i + h 22 + 2^h 2 ih 22 ): Starting from Lemma [6] and applying the data 
processing inequality for the Markov chain x 2 f-> (y'i,y 2 ) -H- (x'i,x 2 ) -H- y 2 , we have 



£R 2 < I{x{;yi) + £e e < I{x'(, x 2 e ; y l 2 ) + £e e < - log(l + h 2 i + h 22 + 2^/h 21 h 22 ) + £e £ . (A.27) 



Note that x( and x 2 are not independent. However, their variance is upper bounded by (\Jh 2 i + 
122) 



^ 2 
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• dGZS-91 ) i?2 < \ log(l + <? 22 ) + \ log(l + fi2i): Consider the cut which partitions the network into 
n s = {Si,S 2 , A,Di] and n d = {B,D 2 }. We have 

£R 2 < I(x e 2 ;yi) + ^ 

= I(xi;y 2 e ) + I(x{; y 2 e \x e 2 ) + I(x'/; j/^) + 1(4; y £ 2 \y 2 £ , x'f) + fe^ (A.28) 

= I(x e 2 ;y 2 e ) + J(x'/; y^) + £e £ 

= I{x e 2 ;y 2 £ ) + I(x'/; y^, x 2 £ ) + &< 

< I log(l + <? 22 ) + - log(l + h 21 ) + le t . (A.29) 

We again used an argument similar to that is used in proof of (|GZS-4h to show that the second and 

fourth terms in (1A.28I ) are zero. 

This completes the proof of the outer bound in Theorem [2] 

A.2 The Achievability Part 

In this section we provide an encoding scheme for the Gaussian ZS network, and show that the rate 
region that can be achieved using this scheme is only a constant bit gap away from the outer bound. 

Large Channel Gains: In this part, we assume that all channel gains are at least 1, i.e., gij > 1, 
and hij > 1. Note that if any of the gains are small, then either one of the rates are small (of the order 
of our constant bit gap), or the cross links are negligible. We will discuss these cases later. 

The encoding scheme proposed for the Gaussian ZS network consists of two separate parts. We first 

split the message of the second source nodes as W\ = U{ and W 2 = (U 2 ,U 2 ,U 2 ), where U 2 

(2) (3) 

can be decoded at both relay nodes A and B, and U 2 and U 2 can be decoded only at A and B, 

respectively (see Figure [TOl). Denoting the rate of message W^ by Tjj, the following rate constraints 

are imposed by this message splitting 

Ri = Ti,i, (A.30) 

R2 = T 2 ,i + T 2>2 + T 2>3 . (A.31) 

An achievable rate region for this message splitting is given in Lemma [Q 

In the second layer of the network (see Figure flTT) . relay node A further splits its messages as follows: 

Wi = U[ l) = (v^\vi 2) \ U { 2 1) = (V 2 (1) ,y 2 (2) ),and[/,f ) = (V 2 (3) , V 2 (4) ) . A similar message splitting 
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is also performed at node B to obtain U 2 = (^2,^2) anc ^ ^2 ^2 : • This messa g e splitting 

imposes the following rate equations 

Ti,i = Si,! + ei )2 , (A.32) 

T 2) i = 02,i + ©2,2, (A.33) 

T 2 ,2 = ©2,3 + ©2,4, (A.34) 

T 2 , 3 = ©2,5, (A.35) 

(i) 
where 0jj denotes the rate of the message V i . Next, the relay nodes have to convey the messages to 

the destination nodes such that D\ can decode V{ , V^ , V 2 and V 2 , and D 2 be able to decode 

V± , V 2 , V 2 , V 2 , V 2 and V 2 ■ An achievable rate region for this transmission scenario is given 

in Lemma |2] 

Putting the rate constraints in Lemma \T\ and Lemma |2] together with the equations in (|A.3QI )- (|A.31b 
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and (1A.32I) - (1A.35I ). we obtain the following achievable rate region for the Gaussian ZS network. 

^a G ch S = {(Rl,R2) :3Ti,i,T 2i i,T 2i 2,T2,3, 61,1,61,2, 02,1, ©2,2, 62,3,62,4,62,5 > 0, (A.36) 

R\ = T"i,i, 

R-2 = ^2,1 + ^2,2 + ^2,3, 

Ti,i = 61,1 + 61,2, 
T2,l = 62,1 + 62,2, 

T~2,2 = 62,3 + 62,4, 
T~2,3 = 62,5, 

Ti,i< Ql og (l + m )-i 

T 2 ,i + T 2 , 2 < ( - log (1 + 512) - - 

Ti,i + T 2 ,i + T 2 , 2 < ( - log (1 + 511 + 512) - - 

T 2 ,i + T 2 , 3 < (-log (I + 522) --) , 

61,1 + 61,2 + 62,1 + 62,3 < ( - log (1 + /in) - - 

61,1 + 62,3 + 62,4 < f-log(l + /l 2 l)-- 

62,5 < Qiog(i + M-^ 

0i,i + 62,1 + 62,2 + 62,3 + 62,4 + 62,5 < ( - log (1 + h 2 i + h 22/ 



iyy 



We apply the Fourier-Motzkin elimination on this region, to project it on the coordinated R\ and R%, 
and obtain the following rate region. After some simplifications, we get 
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ft a G c f = {(R!,R 2 ) :Ri < Qlog(sn) - ^ , 



R2 < i^og(gi 2 + g 22 ) - g 

Rl + R2 < Q log (<?n + 512) + \ log (^) - \ 

R2 < ( 2 log (512) + 2 lo § (^22) - 2 

i?i + #2 < f - log (322) + 2 lo § fan + M - 2 

#1 + #2 < ( r log (311 + 312) + 77 log (h 22 ) - 7; 



< 


Qlo g Cn)-i) 


5 


< 


f -l0g(/l 2 l +h 2 2)- 


1 
"2 



( 2 1 °§(5 f 22) + -log(/l 2 l)- g 

( ^log(/i 2 i + /i 22 ) + ilogr^i 



n- 



Note that this rate region is characterized by a set of constraints which are similar to the inequalities 
in the definition of 7Z GZS , except for the additive constants, and the fact that log(l + x) is replaced by 
log(x). Note that since x > 1, we have 

-log(l + x)--log(x)<-. (A.37) 

Hence, the difference between the RHS's of two sets of inequalities do not exceed 1 for Ri, and 3/2 for 
R 2 and R 1 + R 2 . Therefore, for any rate pair (Ri,R 2 ) G K Q7S , we have (R ± -1,R 2 - 1.5) G TZ^ S . 
This completes the proof. 

Small Channel Gains: We will show in this part that if any of the channel gains are small, then the 
outer bound in Theorem [2] is still within a constant bit gap of an achievable rate region. This argument is 
based on the analysis of the same network, in which all the links with gain smaller than 1 are removed. 
One can show that the capacity region of this modified network is within a constant gap from that of 
the original one. On the other hand, we can argue that the gap between the achievable rate pairs of 
the modified network and the outer bound in Theorem [2] is bounded by a constant. Therefore, we can 
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conclude that if (Ri, R2) G 7£ GZS then (R± — 8±,R2 — 82) is achievable for the original network, where 
8\ = 1 and 82 = 1.5. 

The main intuition behind this argument is the fact that since all the nodes are assumed to have power 
constraint equal to 1, the flow of information through a link with gain not exceeding 1 is upper bounded 
by ^log(l + SNR) < 2 log(l + 1) = 5 bit. Therefore, by removing such links from the network, the 
achievable rates change by at most | bit. On the other hand, the incoming signals over small channel 
gains may act as an interference on the original network, which cause a total noise power not exceeding 
1. Therefore, by doubling the noise variances of the original network, we guarantee that capacity region 
of the modified network is always smaller than that of the original one. 

The advantage of analyzing the modified network instead of the original one is that some of the links 
are removed in the modified network, which convert it to simpler network to analyze. 

A precise analysis of the modified networks requires considering several cases separately. However, 
similar techniques and ideas will be used for all cases. In the following we present one illustrating 
example, and skip the details for the other cases. 



Example 5: Consider the Gaussian ZS network in Figure |3(a)[ and assume that g\2 = 0. Therefore, 
the first layer of the network would be two parallel links as shown in Figure [161 where E[z x 2 ] = 2. 
Moreover, the rate region in (IGZS-lb - dGZS-lOb will be reduced to 

Si _ 1 , A \ D t 



n 7 , 



21 



T - @ ^ty , ^ X (±h-^-Y 



Fig. 16. A modified ZS network obtained assuming g\2 — 0. 
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#i<^log(l + <7u) (A.38) 

fi 2 <^log(l + <7i 2 ) (A.39) 

ill < - log(l + fcn) (A.40) 

i?2<^log(l + M (A.41) 

Ri + R2 < \ log(l + h 2X + h 22 + 2^h 21 h 22 ) + X - log (l + ^ J . (A.42) 

The encoding strategy for this network is fairly simple. Let (Ri,R 2 ) be a rate pair satisfying (IA.38b - 
(IA.42I ). The goal is to show that (R x -1,R 2 - 1) is achievable. Since (R\ - 1,R 2 - 1) satisfies (1A.38I ) 
and (IA.39I ), transmission over the first layer of the network from the source nodes to the relays is simply 
done using random Gaussian codes. 

The second layer of the network is a Gaussian S network. Once the relays decode the messages received 
from the first layer of the network, they encode them using an encoding strategy similar to that of the 
Z network in Example |4] in Section |III] Note that the sum-rate bounds in dA.421 ) and the outer bound of 
the S network are slightly different. However, their difference is upper bounded by 

\ log(l + h 21 + h 22 + 2y/h 2 ih 2 2) ~ I log(l + h 21 + h 22 ) = \ log (1 + - 2V /* 21 ^ ) 
1 1 z \ i + n 2 i+n 22 j 

<ilog(l + l) = i (A.43) 

Therefore, the loss caused by this difference is at most | bit, and {R\ — 1, R 2 — 1) would be achievable. 
On the other hand, as we argued before, the capacity of the modified network is an inner bound for the 
original one, and hence, (R\ —1,R 2 — 1) is achievable for the ZS network as well. 

Appendix B 
The Gaussian ZZ Network 

B.l The Outer Bound 

In the following we present the proof for each of the inequalities in (|GZZ1|) - (IGZZ6I ). separately. We 
again present the Gaussian ZZ network in Figure [TTl to clarify the notation used in the proof. In particular, 
we use two variables, which are the noisy signals received at A and D\ through the cross links assuming 
the direct links were absent, namely, 

7l = V5l2^2 + z[, 



72 = \Zhl2X 2 +z±. 
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Note that y[ = ^/gnx\ + 71 and y\ = \fh\\x' x + 72. 

Suppose that the rate pair (R±, R 2 ) is achieved with a small decoding error probability ee using a code 
of length £. The following chains of inequalities provide upper bounds on the individual rates as well 
as the sum-rate. We again use Lemma [6] which essentially captures the decodability requirements of the 
network. 



y[ v x 'i v^ 




1 




Fig. 17. The Gaussian ZZ network. 



The individual rate bounds in (IGZZlb - (IGZZ4b have the same structure as the cut-set bound, although 
we derive them through a slightly different argument. However, the two sum-rate bounds in (IGZZ5I ) 
and (IGZZ6b are conceptually different than the cut-set bounds. These two bounds which are tighter than 
cut-set bounds are derived through a genie-aided argument; that is, we assume that the signal sent over 
the cross link of one layer is given by a genie to the receiver of the other layer (relay node A in layer 1 
and destination node D\ in layer 2). Therefore, we present the proofs of (IGZZ5b and (IGZZ6b first. The 
more standard cut-set type bounds are provided later for completeness. 
a) The proof of the genie-aided bounds: 

. (IGZZ5T) Ri + R 2 <\ log(l + 511 + 512) + 5 log (l + g ) + \ log(l + h 12 ): We start with the 
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sum-rate inequality in Lemma [6l and write 

£(Ri + R 2 ) < I(y{,yi;x{,xi) + £e e 

<i(y'i,y'2; x i,4) + &£ 
<i(y'i,y'2,ih x i,xi) + £e e 

= I(y'i, l2,x{,x e 2 ) + I(y 2 ; x[,xi\y'(, 7^) + le e 
< I(Vi, l2,x{,x £ 2 ) + I(y 2 , jf; x{,xi\y'{, 72) + £e e 

= i(y'i, i2,x{,4) + Hii ; 4,4bi% ii) + Kv'h x{,x e 2 \y^, 71, 72) + &< 

(B.l) 
Each of the terms in (IB. II ) can be bounded as follows. In order to bound the first term, we can 
simply write 

I(Vi, 72; 4 , 4) = J (72;4,4) + / (^; 3; i>4l72) 

= 1(72; 4, 4) + ^(2/1^72) - %iVi,4,72) 

< /(7^;4,4) + Ky'O ~ h(y'M,4) (B.2) 
= 1(7!; xf, 4) + 1(2/^; 4, 4) 

< /(t|; x^) + /(^; x{, x{) (B.3) 

= - log(l + h 12 ) + - log(l + 511 + 512), (B.4) 

where in (IB.2I ) we have used the fact that conditioning decreases the entropy, and the Markov chain 
72 <-> x 2 <-> y 2 *~> (4>4) ^ 2/i • Also (IB.3I ) follows from the same Markov chain. 
For the second term, we can write 

/(7i;4i4l^>72) = I (^-7i;4,4lyi^72) 

= I{\fmx\\x\,x t 2 \y{;,f 2 ) 

<i{w v AA\y(A) 

<H(W 1 \y' 1 i ,'A) 

< HiwM) < iet, (B.5) 

where the last inequality holds since y\ = y/h\ix( + t| = fi(yi) + 72 = ^(y/jTl)- 
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In order to bound the third term in (IB. lb we can write 

I(v'i\ x i\y'i, 7i> li) = K^Vi^ 7i,72) - h(a£\Vi> vL 7i, 7a) 

<M4l7f)-M4l^,y 2 ',7f,72) (B-6) 

= ^(4l7i) - [M4»*ibi'i s^tI) - ^(*ill/i*» 2/^72)] 

= ^(4l7f) - [M4,*ily^^) - KA\vLvi)\ (b.7) 

= /i(4|7f)-/i(4|y^,y 2 ^7i) 

= / 1 (x £ 2 | 7 f)-/ l (4|xf,^, 7 f) (B.8) 

= ^(4l7i) - [k(4li#>7i) + ^(4l4,y2^7i) - M^il^^f)] 

= / i (x £ 2 | 7 f)-M4ly 2 ',7f) (B.9) 

= i(y , 2 i ;xih() 



(B.10) 



= %2*l7i) 


-h(y' 2 e \j{,xi) 


= Hy'M) 


- h(y 2 \xi) 


= Ky'i - , 


922 f\f\ 1 / 't , — p 1 p 

1 7l 7l) - %2 ~ y/922X2\x2 

912 


= M^ " V 


912 


< K# - 


912 


2 V 912/ 



(B.H) 

(B.12) 

where in (1B.61 ) we have used the fact that conditioning reduces the differential entropy, and (IB.7I ) 
holds due to the Markov chain {x 2 ,t\) <-> {Vi,y 2 ) ^ It Then in (1B.8I ) we replaced (y7>7i) by 
(»i,7l) since there is an one-to-one map, y'f = y/giix\ + t\, between these joint variables, and 
in dB.91 ) we used the fact that x\ is independent of (x 2 ,y 2 ,t±) t° conclude /i(xi|24>£/2 £ >7i) = 
/i(a^|y 2 £ )7i) = /i(x)- Also ( IB. 101 ) holds due to the Markov chain y 2 ^ x 2 ^ 7 f. Finally, ( IB. Ill ) is 
true due to removing conditioning and the fact that z' 2 is independent of x 2 . 
Finally for the last term in (IB. lb we have 
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I{y 2 e ; x[\xi,y'f, 7 f , 7 |) < J(y 2 £ ; Wi|2& 2/7, 7i, 72) 

< if (Wi |^,72) 

< H(^i|^) (B.13) 
<ie/, (B.14) 

where (IB. 131 ) is due to the fact that y[ = \fh\\Xy + 72 = fi(y'i) + li = hiv'iili) * s a function 
of (2^,72), and dB.141 ) is just the Fano's inequality. 
Replacing (IbH ). (I53T ). (lB~T2l . and (I5TT41) in (|B~TT ). we get 

Ri + R2<l log(l + 511 + 512) + 7^ log ( 1 + — ) + ^ Ml + M + 3&/. (B. 15) 

2 2 \ c/12/ 2 

• dGZZ6b Before proving this inequality, we present a lemma which will be used in this proof. We 

will present the proof of this lemma later in Appendix 

Lemma 7: Let X\ and X2 be two (arbitrarily correlated) random variables with variance constraints 

E[Xf] = a\ and E[Xf] = o\, which form a Markov chain Ii f> T f> I2 for some random variable 

T. Also assume that Z is a zero-mean unit variance Gaussian random variable independent of X\, 

X2 and T. Then the conditional differential entropy of Y = X\ + X2 + Z is upper bounded by 

h{Y\T) < -log 2ire(l + al + of). (B.16) 

Now, in order to prove (1GZZ5I ). we start with Lemma [6] 

£(Ri + R2) < I(y{,y £ 2;x{,xi) + £e e 

< i{y e i,y e 2,ihx{,xi) + ie £ 

= I(y[,lhx[,xi) + I{yi- x{, x e 2 \y{, 7l ) + £e e 

= I(j(;x{,xi)+I(y{-,x{,xi\^i) + I(yi;x{,xi\y{,^i)+£e £ . (B.17) 

Since jf is independent of x\ , the first term can be simply bounded as 

Hii;4,4) = i(ihx e 2 ) + i(t e -x{\xi) = i(>A;4) + i(zi;4\4) < \ Mi + 512)- (b.is) 
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For the second term we can write 

I(y(;x{,xi\ji) = %i|ti) - %iki)4,7i) 

<%il7f)-M2/iK/^2) (B.19) 

= Hvihi) - h (4\ x 'i , x 2 e ) 



= h(y/hnx{ + V/ti 2 a;2 + 4\Ti) ~ h (4) 

< - log (2vre(l + /in + h 12 )) - - log 2vre (B.20) 

= ^log(l + /in + ^i 2 ), (B.21) 

where (jB.19[) follows from the Markov chain y\ -H- (x'/,x 2 £ ) <R- {x\,x 2: ^i). I n (|B.20[) we have 
used Lemma [7] for tf, xf and x 2 £ which form a Markov chain, since 

I(x{;x 2 %) < I{y'hy'i\t{) = I( y -±-S;y 2 %) = I{x[-yf\t[) = h{x[\t[) - h{x{\t[,y'f) = 0. 

The third term can be further upper bounded by 

I(y e 2 ; x{,xi\y{,j{) = h(yi\y{,^{) - h(yi\x{,xi,y{,-f{) 

<Hyi\ylii)-h(yi\x 2 e ) (B.22) 

< Hyilylji) - hiyilx'lxlylji) (B.23) 

= I(y e 2 ;x' 1 e ,x 2 e \y[,j{) 

<i{yi,ii\x'(,x'£\y[,4) 

= I{^x'lx 2 %l4) + I{yi-,x\\xi\y[ n W 2 ), (B.24) 

where both (IB .221 ) and (1B.231 ) follow from the Markov chain y 2 ^ x ' 2 ^ ( x i>2/i)7i)- Now, we 
have 
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I{ni;x'^,x'i\y[^[) = I{y[ - l 2 ;x'l,x'£\y[^[) 
= IWhuXi;x 1 t ,x 2 t \y{,rt) 

</(^;x7,x 2 £ |yf, 7 f) (B.25) 

<I{yf-t[;xl,x'i\y[A) 
= I{ y /gEx[;x 1 t ,x 2 l \y[,Yi) 

<I{Wr,x't,x'MA) 

< H(W!\yi) < £e t , (B.26) 

where (IB.25I ) follows from the fact that x/ is a function of y/. Finally, 



I(y2,x'i,x 2 e \y[, ~f{,4) = h(yi\y{,~i[,-ii) - /i(^|yf,7f,7^x'/,4 £ ) 



%£ / "-22 £, £ £ £\ lit H '£i £ £ £ '£ '£\ 

2 - \l ^—72^1,71)72) - %2 - Vh22X 2 \yi,Jl,l2,Xl,X 2 ) 



\h 22 £, £ £ £\ , / £ I £ £ £ '£ ' £\ 

H4- \l —ZiWiilnrt) -K4 1^1,71,72^1^2) 



< H4 - S^A) - H4) (B.27) 

Here, in (IB .271 ) we have used the fact that conditioning decreases the differential entropy, and the 
fact that z 2 is independent of {y[^[ ,4-> x 'i-> x 'i)- Replacing (IB. 18b . (IB.21I ). (IB.26I ). and (IB.28I ) in 
( IB. 17b , we will obtain the desired inequality. 
b) The proofs of cut-set type bounds: 
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• (IGZZlb R\ < \ log(l + ffu): The individual rate bound can be simply obtained from 

lRi = I(x{;y{)+lee 

<I(x[;y'(,y'i)+lee (B.29) 

= I(x{ ; y'(\y' 2 l ) + I(x{;y' 2 e ) + le t 

= h(y' 1 i \y' 2 i )-h(y'M,y' 2 i ) (B.30) 

< h(y'i\4) - h (z'i\ x l,y2) 

= h(y/g^x{ + z() - h(z?) + le £ 

< - log(l + 511) + let, 

where dB.291 ) follows from the data processing inequality for the Markov chain x\ -H- (y'f, y 2 ) 4-} y\, 
and (IB .301 ) follows from the Markov chain y'/ «->• xr 2 ** y' 2 )- Note that eg — > as I grows. It 
is worth mentioning that this bound is similar to the cut-set bound for the cut Q s = {Si} and 
n d = {S 2 ,A,B,D 1 ,D 2 }. 
. (IGZZ21 R 2 < ilog(l+ ff2 2): 

For the second rate bound, we can start with Lemma [6] and write 

IR 2 < 1(4; y{) + le e < I{x{;y'l) +lse<l log(l + 522) + lee, 

where we have used the data processing inequality and the Markov chain x 2 -H- y' 2 -H- x 2 -H- y 2 in 
the second inequality. Note that this bound captures the maximum flow of information through the 
cut specified by Q s = {S 2 } and $7^ = {S%, A, B, D\,D 2 }. 

• (1GZZ3I ) R\ < \ log(l + /in): In order to prove this upper bound, we use the cut-set bound for the 
cut n s = {Si, S 2 , A, B,D 2 } andn d = {Di}. 

lRi<I{x(;y[\x'i)+lee 

= KVi\ x 'i) ~ h{y[\x'(,x' 2 l )+lee 

= h(\/hnx'f + z[\x' 2 ) — h(z[\x'(,x 2 ) + lee 

< h(\/hTix'i + z[) - h(z[) + lee 

< -log(l + /in) + lee- 

• (1GZZ41 ) R2 < \ log(l + h 22 ): Starting from Lemma we can write 

IR 2 < I(x 2 e ; y{) + lee < I(x'f; y e 2 ) + ^e<\ Iog(l + h 22 ) + le e , 
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where the second inequality follows from the data processing inequality for the Markov chain 

£ '£ '£ £ 

^2^2/2 " x 2 " 2/2- 

This shows that the rate region in Theorem |4] is an outer bound for the achievable region region of the 
Gaussian ZZ network. 

B.2 The Achiev ability Part 

In this section we present an encoding/decoding scheme, and derive an achieve rate region for this 
strategy. We then show that the gap between the boundary of this achievable rate region and that of the 
outer bound presented in Theorem |4] is upper bounded by a constant. 

Similar to the Gaussian ZS network, we only consider the large channel gain case, where we assume 
that all the channel gains are lower bounded by 1. A similar argument to that we used for the ZS network 
shows that for small channel gain cases the network is reduced to a simple one and its gap analysis is 
fairly simple. 

We essentially use the result of Lemma [3] as an achievable rate region for the Z-neutralization network. 
We use notation (X g ,fi g ) and (Aft, fih) to distinguish between A and \x parameters of the first and the 
second layers of the network. 

In the first layer of the network, each source node splits its message into two parts, namely, functional 
and private parts, W\ = ( U[ , U\ ) and W2 = ( £/ 2 ,U 2 '), where the functional parts, have the same 
rate, i.e., Y^o = Y 2j o = Yo. Both transmitters use a common lattice code to encode their functional 
sub-messages into xi.o = il)(U\ ) and X2.0 = ^(U 2 )> where ^ is the one-to-one encoding map induced 
by the lattice code. We define the partial-invertible function by 

<j>{u[°\vf)=$- 1 (mi 0) ) + m^)) =^- 1 (x 1 ,o + x 2 , ). (B.31) 

We denote the rates of the private sub-messages by Yi and Y2, where Y, = Ri — Yo, for i = 1,2. 
The goal is to encode and forward messages to A and B in such a way that A can decode U{ and 
4>{U[ ,1/2 ), and B can decode U 2 and U% . Based on Lemma [3l this can be done provided that 

Y < Qlog(A 9 )-i 

Y + Yx< Qlog( 5ll )-l 

Y + Y 2 < f - log (522) - 1 

Y + Y 1 + Y 2 < QlogO* fl )-| 
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The second layer of the network is another Z-neutralization network with transmitters A and B, and 
receivers D x and D 2 . We use v} 0) = V" 1 U(ui 0) ) + ip(U^ 0) )\ v} 1] = u[ 1} as the functional and 
private messages of the first relay node, and V% = ^ _1 (— x 20 ) = il)~ l (— ^(U^ )) and V 2 ' = U^ ■' for 
the functional and private messages of second relay. Denoting the corresponding rates by Go, Oi, and 
62, we have 

e i = T i , * = 0,1,2. (B.32) 



The goal is to encode and send these messages to the destinations, such that D\ can decode <p(V^ , V% ) 
and V} 1] , 
Lemma [3] 



and Vi , and D 2 can decode V 2 and V 2 . Again we use the achievable rate region proposed in 



(ilog(A,)-^ 



( ^ log fan) -1 

( ^iog(M-i 

( Ilog(^)-^ 



Note that the first destination observes 4>(V^ , V 2 ), which is equivalent to 

= r 1 (mi 0) ) + m { 2 ] ) - wPJ) 0.33) 

= U[°\ (B.34) 

Therefore, combining it with V± = U{ , the first destination node can decode W\. The second 
destination node D 2 has V 2 and V 2 = Ul ; , and can compute 

and hence it decodes W 2 . 
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This scheme can reliably transmit the messages with rate pair in 

^a G ch Z = {(Ri,R2) B T ,T 1 ,T 2 ,@ ,e 1 ,e 2 > 0, (B.36) 

r 2 = g + @ 2 , 

Oi = r u i = 0,1,2, 

1, „ , i x + 



T < [^log(X g ) 



( \ log (<m)- 



To -+ ( - log (522) - 1 



T + Ti + T 2 < ( - log (fi g 



1 
2~ 



e < Q log (A ft ) -i 
e + e!< Qiog(/i u )-i 
e + e 2 < Qio g (M-i 

9 + 9i + G 2 < Q log (/ift) - £) } . (B.37) 

It only remains to apply Fourier-Motzkin elimination to project this region onto (Ri,R2). This gives 
us 



^ a G ch Z = {(Ri,R*) -Rx < Qiog(5n) - 1) 



(iiog(/m)-i^ 

1 ^ + 

R2 < ( - log (522) - 1 



( i log (/l 22 ) - 1 



1 

2" 



Rl+R2<[^ log (fig) + - log (Aft) - - 



Ri + R 2 < (^log( / uft) + ilog(A g )-0 }. 
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Note that the RHS's of the sum-rate bounds depend on the order of the channel gains. For most of possible 
orderings, these two inequalities would be consequences of the individual rate bounds. For example, if 
^h = ^22> then the last bound is implied by the first and fourth bounds, since fi g > g\\. It can be shown 
in general that TZ^ Z is equivalent to 



^a G ch Z = {(Rl,R2) :Rl < QlogOll) " l) 



1 X + 

Ri< f-io g ( 522 )-i 

R 2 < (^log(hn) - l) , 

i?2<Ql0g(M-l) . 

Ri + R2 < ( ^ log(/x 5 ) + - log(h l2 ) - - 

Ri+R 2 < Qlog(/x ft ) + ^log(3i2)-^J }• 

Now, note that g\\ > 1, gi 2 > 1, and 322 > 1- These imply 

1 1 /-, , , n , 1, A , 922\ ,1, /9 r n . 1, f2max{g 12 ,g 2 2} 
-log(l+5n +512) + 77 log 1 + < -log(3max{5ii,5i 2 }) + -log 

2 2 V 312/ 2 2 V 3i2 

1 /max{pn,pi 2 } -max{322,9i2}\ 1, „ 
< 77 log + - log 6 

2 V 512 / 2 

<-log(^, z ) + -log6. (B.38) 

We also have 

ilog(l + x)<ilog(x) + ^ (B.39) 

for all a; > 1. Applying (IB.38I ) and dB.391 ), we obtain the following achievable rate region, which is a 
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subset of TZ^ Z . 



^a G ch Z 2 = {(Rl,R2) :Rl < Ql0g(l +9ll) - fj 



R2< Ql0g(l+ 5 22)-^ 

R x < Qtog(l + /ni)-| 

R2< Qlog(l + /l22)-| 

i?i + ^2 < Q log(l + 511 + 512) + \ log (l + ^ + \ log(l + M - ^ 

i?i + ^2 < Q log(l + /» u + h 12 ) + i log (l + Q + i log(l + g 12 ) - 7 -\ } 

Therefore, for any rate pair (Ri,R 2 ) £ TZ GZZ , the rate pair (i?i — ^logl2,i?2 — \ log 12) belongs to 
7^ach2> anc ^ therefore can be achieved using the proposed encoding scheme. 

Appendix C 
Proof of Lemmas 

Discussion of Example |?] in Section |777]- The converse proof is fairly simple and follows from a 
similar argument we used to prove (IGZS-lb . (1GZS-2I ). and dGZS-31 ) in Appendix lAl 

In the following we will present an encoding strategy which guarantees to achieve rate pair {R\ — 
\,R 2 — \), provided that (i?i, R 2 ) 6 Tl z . This gives us an approximate capacity characterization for the 
Gaussian Z network. In order to do this, we consider the following two cases. 
Case A: g 12 > g 22 

Assume (R±,R 2 ) be an achievable rate pair. Then, the first receiver G\ is able to decode W\ sent at 
rate R\ , and remove the signal associated to W\ from its received signal. The remaining signal provides 
a higher SNR to decode W 2 than the signal received at G 2 . Therefore, in this particular regime, the first 
receive would be able to decode both messages. Hence, we have a Gaussian multiple access channel 
from F\ and F 2 to G\, combined with a line network from F 2 to G 2 . Therefore, the intersection of the 
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rate regions of the Gaussian MAC and the line networks is simply achievable. That is 
^ach,A = j (RuRz) -Ri<l log (l + gn),R 2 <l log (1 + 512) , Ri + R2 < I log (1 + gu + gi 2 ] 



n 

(Ri,R 2 ):R 2 <^ log (I + 522; 

={(Ri, R 2 ) -Ri<\ log (1 + 5ii) , R2 < 2 log (1 + 922) , Ri + R 2 < ^ log (1 + 5ii + 912) }• 

(C.l) 
Note that the individual rate bounds in 1Z Z and R z chA are the same. Moreover, the difference between 
the sum rate bounds is bounded by 

ilog(l + ^)<ilog(i + l) = i (C.2) 

2 V 912/ 2 2 

Therefore, the gap between each boundary point of 1Z Z and R z chA is at most i bit. 
Case B: g 12 < g 22 : 

The encoding scheme we introduce for this case is similar to Han-Kobayashi's scheme for 2-user 
interference channel. We first split the second message W 2 into the common and private parts, W 2 = 
(Wf, Wf), with rates R% and R\, respectively, where VFJ can be decoded at both receivers and Wf is 
only decodable at G 2 . Sub-messages W\, W$, and W\ are encoded by corresponding randomly generated 
Gaussian codes to xi, x| and Xg, and the resulting codewords are sent over the channel. 

We allocate a p = l/gi 2 fraction of the transmission power available at F 2 to W$, and the remaining 
power a c = 1 — a p is allocated to WJ. Therefore, we have 

X2 = V«c x 2 + \/«^ x 2- 

The first receiver, G\, decodes W\ and W£ treating W 1 ^ as noise. Therefore, the effective noise power 
received at G\ would be E[^/gi 2 a p x p + z\] 2 = 2. According to the capacity region of Gaussian multiple 
access channel, this can be done provided that 

Ri <ilog(i + ^), 

R c 2 <±log(^p), (C.3) 

Ri + R c 2 <^log( 1+ -^ +g12 )- 
The second decoder first decodes W% treating W% as noise. It then removes the corresponding codeword 
from the received signal, and decodes Wf. This can be done as long as 

R% < i log ( ,} +9 f ) , 

2 - 2 & V. 1+922/912/ ' ,Q ^N 

RP <l log (l + ^ N 
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Note that we have two upper bounds for R?,. However, it is easy to show that 1+ +3 / 2 — > + 2 12 , 
for 1 < gi2 < g 22 , and therefore, the first bound dominates the second one. Using Fourier-Motzkin 
elimination to write the achievable region in terms of R± and R2 = R 2 +R 2 , an d after some simplification, 
we get that the region 

^ach,B = {(Rl,Rz) -Rl < \ ^g (1+ 5ll) " \, (C5) 

R2<\\og{l+g 22 )--, (C6) 

Ri+R2<\\og{l + g ll +g 12 ) + \\og(l + ^\ -\\. (C.7) 

2 2 \ g 12 ) 2 J 

is achievable. Therefore, if (Ri,R 2 ) G 1Z Z , then (Ri — \,R 2 — \) is achievable. ■ 

Proof of Lemma [7] in Section [Vf The following achievability scheme simply uses superposition 

encoding of sub-messages at F 2 , and a successively decode and cancel strategy at G\ and G 2 . We use a 

random codebook with a proper number of codewords, generated according to a zero-mean unit-variance 

Gaussian distribution for each message. A proper power allocation for the messages at the transmitters 

allow the decoders to apply a decode and cancel strategy. We denote the codeword corresponding to the 

(i) 
message JJ\ by xy, and the power allocated to this message by 014 j. 

The available power at F 2 can be arbitrarily allocated to its sub-messages. In particular, we choose 
the power coefficients so that they satisfy 02,2 < l/522> "2,3 < l/5i2> an d «2,i = 1 — «2.2 — 02,3- In 
the decoding part, G\ and G 2 treat C/g and U^ , respectively, as noise. Therefore, the total noise at 
G\ and G 2 would be zi = Jgi 2 a 2 ^2,2, + z i an d Z2 = -1/(72202,2X2,2 + z 2- However, the effective noise 
power cannot exceed 2 since E[gi2«2,3 + 1] < 2 and E[g22«2,2 + 1] < 2. 

The receiver F\ observes a Gaussian multiple access channel (with noise power upper bounded by 
2), where U\ is sent by one user, and (C/ 2 ,U^ ) is sent by the other user. The bounds in (TTb-dTQb 
guarantee that these rates are achievable over the multiple access channel. 

On the other hand, the channel from F 2 to G 2 is Gaussian point-to-point channel with modified additive 
noise. Therefore, any total rate not exceeding its capacity can be reliably transmitted. This is condition 
is fulfilled here since T2,i + T2,3 satisfies (fT2l . Finally, the bound on the power allocated to f/ 2 upper 
bounds its rate as in (TTTb - 

■ 

Proof of Lemma \2\ in Section [V|- Again, the achievability scheme we propose for the Gaussian 

S interference network (illustrated in Figure ITTb is based on superposition coding, and a successively 

decode and cancel decoding strategy, such that the requirements of the problem are fulfilled. A proper 
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power allocation is required to guarantee achievability of the rate tuples mentioned in this lemma. 

Note that G\ does not decode V 2 ' and V 2 , and treats them as noise. We choose the total fraction of 
power allocated to V 2 and V 2 to De at most l//in, that is 02,2 + «2,4 < 1/^n- Therefore, the total 

noise power received at G\ is upper bounded as E[/iii (0:2,2 + 02,4) + 1] < 2. 

(2) 
Similarly, V± is treated as noise at G2. By bounding the fraction of power allocated to this sub- 
message, we can upper bound the effective noise power observed at G2 by E [/in (0:2,2 + 02,4) + 1] < 2. 
The point-to-point Gaussian channel from F\ to G\ can support any sum-rate below its capacity as in 
(fT3l) . Moreover, Oi,2 is bounded above since its allocated power does not exceed l//ii2- 

On the other hand, we have a Gaussian multiple access channel from F\ and F2 to G2, with total noise 
power not exceeding 2. The bounds in (fT51)-(fT8T) guarantee that the desired rates belong to the capacity 
region of this channel, and therefore they are achievable. We skip the details of power allocation here, 
but we point out that the achievability of the region is a consequence of the Gaussian multiple access 
rate region achievability. 

■ 
Proof of Lemma \3\ in Section 0' In this part we show that any rate tuple satisfying (f2Tb-(l24b is 
achievable. The main idea of this proof can be summarized as follows. 

• Use a common codebook with group structure, such as lattice codes, for W{ and W 2 , which 
maps them to x^o and X2 ) o 

• Choose a proper power allocation for xi : o and X2 i o such that they get received at G\ at the same 
power level; More precisely, denoting their power allocation by oo and j3q, they should satisfy 
gii&o = 9i2^o- This condition guarantees that the two lattice points get scaled by the same factor, 
and therefore the result is still a lattice point on the scaled lattice and can be decoded as long as 
enough signal to noise ratio is provided. 

• Use random Gaussian codebooks to encode the private sub-messages to xii and X12, and use proper 
power allocation, oi and (3\. 

The first receiver G\ needs to decode the partial-invertible <fi which we define as 

(wi°\ w 2 (0) ) = ^r 1 (v> (V x (0) ) + v (< } )) 

= V> -1 (xi )0 + x 2 ,o) 

where tp is the one-to-one encoding function which maps the functional messages to the common lattice 
codebook. Note that the group structure of the code impels that x^o + X2 ) o is still a valid codeword. It 
is easy to check that this function is partial-invertible. 
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Let us define 



77 = nun < 511,512,522, 



9U922 

912 



(C.8) 



Depending on the minimizer in 77, we identify four cases. In each case, the achievable rate region is a 
polytope, with a certain number of corner points. It suffices to show the achievability only for the cornet 
points, since a standard time-sharing argument guarantees achievability for the rest of the region. 

The proof details for each corner point includes message splitting, and power allocation for sub- 
messages such that the decoders be able to decode corresponding messages. In the following we describe 
this strategy in details for the case where 77 = 511. The extension of this method for other cases is 
straight-forward, and therefore we skip it here to sake of brevity. 

Case I. 77 = 511: It is clear from the definition of 77 that in this case 511 < 512 < 522. and 
therefore A = 511 and /j = 522- Hence, the desired region is characterized by all non-negative rate tuples 
(P ,Pi,P 2 ) satisfying 

Po + Pi<^log(<7ii), 

P + Pi + P 2 < \ log (522) • 

This rate region is illustrated in Figure [18] It suffices to show that the corner points A, B and C are 
achievable, since the points D and E are degenerated from B and C, respectively. 




Fig. 18. Achievable rate region of the Z-neutralization network when ?y = gn. 



A:(P ,Pi,P 2 ) = (0,0,ilog(5 22 )-|) 

The encoding strategy for this corner point is fairly simple. The second transmitter uses all its 

available power to send W% , while the first transmitter keeps silent. That is, xi = and X2 = X2,i. 
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The first decoder has nothing to decode, and the second one can decode X2 from y 2 as long as 
Pi < ^ log (1 + 522)- It is clear that in particular Pi = \ log (522) — § is achievable. 

B:(P ,P 1 ,P 2 ) = ( 1 1 \og(g n )-hO, 1 1 log(g 22 )-±log(g 11 )-k) 

The first encoder sends its lattice codeword with power allocation ao = (gu — l)/gn. The second 

encoder splits its private message into W 2 = (W 2 ' ,W 2 ) of rates P 2: i and P 2>2 where P 2 = 

P 2j i + i"2,2- Then it sends 

X2 = x//3^LX 2l l : l + V^0X 2 ,0 + \/^2 X 2,l,2 

where the power allocation coefficients are fixed to be /?i 2 = l/gi 2 , /?o = (<?n — l)/5i2 ; and 
/3ii = 1 — /3o — /?i,2- The signal received at the destinations are 

yi = V9U X 1 + V#12 X 2 + z l> 



= \/gi2 - 511x2,1,1 + V5ii-l[xi,o + x 2 ,o] + X 2 ,l,2 + Zl, (C.9) 

Y2 = V^22 X 2 + z 2, 



/ 522 (512 -5ll) / 522(511 - 1) /527 . ,„ im 

= W X 2 ,l,l + W x 2 , + W — X 2 ,l,2 + z 2 . (CIO) 

V 512 V 512 V 512 

The first node decode and cancel X2,i,i, xo = x^o + X2,o, and X2,i,2 in order, while the second 
one performs the same decoding for X2,i,i, X2,o, and X2,i,2- It is easy to show that the rates P 2) \ = 
\ log (512/511) - 0.5, P = \ log (511) - 1, and P 2 ,2 = \ log (522/512) are achievable, which implies 
the private rates P 2 = i-2,1 + ^2,2 = \ log (522/511) — \ for the second transmitter. 
. C : (P , Pi, P 2 ) = (0, \ log (g n ) ~ 1, \ log (522) - \ log (511) - \) 

For this rate tuple, the rate of the functional message is zero. The second transmitter splits its private 
message similar to that of corner point B. The transmission power is distributed between among 
the sub-message as ao = 0, a± = 1, /?i,2 = I/512, A) = 0, and /3i,i = 1 — /3i,2- A similar argument 
to that of corner point B shows that the rates P2,i = \ log (512/511) — 0.5, P\ = \ log (511) — 1, 
and P2,2 = \ log (522/512) are achievable, which implies the achievability of the rate point C. 

m 

Proof of Lemma \4\ in Section fyl.2\ Let (Ri,R 2 ) € 7£ DZS be an arbitrary rate pair which satisfies 
(IDZS-llHlDZS-lOl) . In particular Pi < min{mn, n u }. We claim that (Pi, P 2 ) G K^ zs {t) x PJ? zs (i) for 
t = Pi, and therefore (Ri,R 2 ) is achievable using network decomposition. In order to do this we have 
to show that any P 2 satisfying (IDZS-lb - (IDZ5-lQb . fulfills the constraints in the definition of P.!? zs (Pi). 
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Using (IDZ5-2D and (IDZ5-3I) . we have 

R 2 < min(max(m 11 ,m 12 ) + (m 22 - m 12 ) + - Ri,max(mi 2 ,m 22 )) 

= min(max(mn,mi 2 ) - i?i, 77112) + ("122 — "ii2) + 

= m' 12 (Ri) + (m 22 - mi 2 ) + 

< m' 12 (i2i) + (m 22 (i?i) - mi 2 (i?i))+ (C.ll) 

= max(m / 12 (-Ri),m 22 (-Ri)), (C.12) 

where in dC.111) we have used the fact that 

(min(a, b) — min(c, d)) > min ((a — c) + , (fo — <i) + ) . 

Moreover, since R 2 satisfies dDZS-31 ), (IDZS-51 ), and dDZS-81 ), we have 

R 2 < min ( max(mn,mi 2 ) + (m 22 - mi 2 ) + - Ri,m 22 + max(nn, n 2 {) - Ri,m 22 +n 2 \) 

< min (max(mn,mi 2 ) + (m 22 — mi 2 ) + — Ri,m 22 ) + min (max(?in,n 2 i) - i?i,n 2 i) (C.13) 

= m' 22 (i?i) + n / 21 (i? 1 ), (C.14) 

where (IC 13b holds since 

min(a, b) + min(c, d) > min(a, b + c, b + d), 

for non-negative a, b, c, and d. 

In order to show that the third constraint is satisfied, we can start with (IDZS-41 ). (IDZS-61 ), and dDZS-lOb . 

R 2 < min ( max(mn,mi 2 ) + n 22 + — i?i,mi2 + n 22 ,max(nn,n 2 i) + (n 22 - n 2i ) + - i?i) 

< min (max(mii,mi 2 ) + -Ri,mi 2 ) + min (max(nn,n 2 i) + (n 22 - n 2i ) + - Ri,n 22 ) 

= m' 12 (r 1 )+n , 22 (r 1 ). (C.15) 

Finally, using (IDZ5-8I ) and (IDZS-lOb . we have 

R 2 < min (max(nn,n 2 i) + (n 22 - n 2 i) + - ri,max(n 2 i,n 22 )) 
= min (max(nn,n 2 i) - n,n 2 i) + (n 22 - n 2i ) + 
= n 2i( r i) + (n 22 - n 21 ) + 
< n' 21 (ri) + (n' 22 (ri) - n' 2l {n)) + 
= max(n 21 (ri),n 22 (ri)). (C.16) 
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Putting inequalities in (IC. 12b and (IC. 14b - (IC.16b together shows that R 2 G TZ^ zs (Ri), and completes the 
proof. ■ 

Proof of Lemma [5] in Section \VII.2\ 

The coding strategy we present here is based a network decomposition, where the sub-nodes and the 
links of the deterministic Z-interference network are partitioned into two disjoint sets. We analyze the 
rate region of each network, and derive an achievable rate region for the original network based on this 
analysis. 

We just point out here that in this coding strategy, the second sender F 2 , never sends a bit on a sub-node 
which is not received at G 2 , even if n\ 2 > n 22 . 

The first partition of the network M\, consists of those sub-nodes in G\ which are connected to one of 
the top mix sub-nodes of F\ and one of the top m 22 sub-nodes of F 2 . All the sub-nodes in the network 
which are related to (see Definition [3]) any of these sub-nodes also belong to the first network partition. 
The remaining nodes and link form the second part of the network J\f 2 . It is clear that these two networks 
are node-disjoint, and do not cause interference on each other. 

We first characterize the number sub-nodes in Gi which belong to M\, by determining whether each 
of them can receive a bit from F\, F 2 , or both of them. We denote the number of levels in G\ which 
are only connected to a transmitting level in F\ by k\. Similarly, the number of those only connected 
to a a transmitting level (the top min(ni2, rc.22)) in F 2 by k 2 . Finally, ko denotes the number of levels 
which are connected to transmitting levels of both F\ and F 2 (see Figure [T9l ). 

First, we derive ko. Enumerate the levels of G\ from 1 (for the highest) to q (for the lowest). Let j 
be the index of a sub-node in G\ belong to J\f\, i.e., it receives bits from both F\ and F 2 . Its neighbors 
in F\ and F 2 (if there is any) are indexed by j + ran — q and j + m 2 — q, respectively. Therefore, j 
belongs to J\f\ if and only if 1 < j + ran — q < ran and 1 < j + rai2 — q < min(rai2, n 22 ). Therefore, 
the number of such sub-nodes is given by 

k = [mm{q, q-ni 2 + n 22 } - max{g - ran, q - ni 2 }} + 

= min{ran, ra i2 , ra 22 , (ran + n 2 2 - ni 2 ) + }. (C.17) 

It is clear from the definition of ko that the remaining ran — ko lowest levels of Gi are only connected 
to sub-nodes of F\, and hence, ki = ran — ko- Similarly, min{rai2,ra22} sub-nodes in Gi are receiving 
information from F 2 , where ko of them are also connected to Fi. Therefore, the remaining sub-nodes 
are only connected to G 2 . Thus, k 2 = min{ni2,ra22} — ko. 

We partition the network into two parts: The first part consists of the ko sub-nodes of Gi connected to 
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Fig. 19. A deterministic Z-neutralization network. The upper 2 sub-nodes in Gi are only connected to F2, and therefore 
&2 = 2. The next 3 sub-nodes receive information from both Fi and F2, and hence fco = 3. Although the lowest sub-node is 
also connected to both transmitters, it only receives information from Fi since F2 keeps silent on its sub-nodes below ri22- 



both F\ and F 2 , and sub-nodes connected to them. The remaining sub-nodes form the second partition of 
the network. We characterize the achievable tuples for each, denoted by (Q' , Q[, Q' 2 ) and (Qq, Q", Q%), 
respectively. The fact that these two partitions are isolated allows us to conclude that the summation of 
such achievable tuples is also achievable for the original network. 

Consider the first partition of the network. It is clear that any of the k$ levels of G\ connected to both 
F\ and F 2 and can be used to communicate a functional bit, since G\ naturally receives the xor of the 
transmitting bits. On the other hand, such sub-node can be used to communicate one private bit from 
any of F\ or F 2 to G\ by keeping the other one silent. Therefore, any rate tuple satisfying 



Q'o + Q[ + Q' 2 <ko 



(C.18) 



is achievable. 

The non-interfered links of the second partition of the network can be used to send private bits from the 
transmitters to G\ simultaneously. Moreover, each transmitter can use one of its non-interfering sub-nodes 
to send a functional bit to G\, and then, G\ computes their xor, after receiving them separately. This 
can provide up to min{fci, k 2 } new functional bits for G\. Moreover, the lower {n 22 — n\2) + sub-nodes 
of F 2 which are connected to G 2 but not to G\ can be used to send private bits to G 2 without causing 
any interference at G±. 
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Hence, this strategy can transmit any rate tuple satisfying 

Qq < minj&ijfo}, 

Qo + Q'l < h, 

Q'o + Q 2 <k 2 + (n 22 -n 12 ) + . (C.19) 

Summing up the rates achieved on each partition of the network, we have arrive at Qi = Q\ + Q'l 
for i = 0,1,2, where {Q' ,Q[, Q^'s and {Qo,Q",Q 2 ) satisfy (ICT8l) and (ICT91 ). respectively. It only 
remains to apply the Fourier-Motzkin elimination to project the rate region on the (Qo,Qi,Q 2 ) space. 
This gives us 

Qo < ko + min{/ci, k 2 }, 

Qo + Qi< ko + ki, 

Qo + Q2 < k + k 2 + (n 22 - n 12 ) + , 

Qo + Qi + Q2<k + k 1 + k 2 + (n 22 - n 12 ) + . (C.20) 

Some simple manipulations show that the RHS's of the inequalities in dC20| ) are the same as that claimed 
in the lemma. 

■ 
Proof of Lemma |6] in Appendix \A.1\ As mentioned before, we will use the Fano's inequality in 
order to prove this lemma. We have 

IRi = H(Wi) = I{Wr,y{) + HiW^yi) 

<I(W i; yf)+^ (C.21) 

<I(x{;y{) + £ee, (C.22) 

where dC21| ) is implied by the Fano's inequality, and in (IC.22I ) we used the data processing inequality 
for the Markov chain W\ f-> x\ <-> y{. Note that where eg — > as I grows. The proofs of the other two 
inequalities follow the same lines, and we skip them to sake of brevity. ■ 

Proof of Lemma\7\in Appendix \B.l\ Note that Z is independent of everything else, and X\ and X 2 are 
conditionally independent. Without loss of generality we can also assume that ^(7) = E[JQ|T = 7] = 
for V7 (otherwise for any given V = 7, we can shift Xi by ^(7), while the entropy does not change). 
Let E[X?|r = 7] = of (7) for i = 1, 2. Therefore the conditional variance of Y can be bounded as 

E[Y 2 |T = 7] = E[(Xi + X 2 + Z) 2 \T = 7] = (j?(7) + ff|(7) + 1. (C.23) 
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Therefore, 

h(Y\T) = E r [/i(y|r = 7)] = E T [h(X l +X 2 + Z\T = 7)] 

< E r [log 27re(af (7) + a 2 2 ( 7 ) + 1)] (C.24) 

< log27re(E r [^(7) + a 2 2 ( 7 ) + 1]) (C.25) 
= log 27re(al + a\ + 1), (C.26) 

where in (IC.24I ) we have used the fact that Gaussian random variable has the maximum differential 
entropy among all random variables with the same variance, and (1C.25I ) follows from the concavity of 
the function log(-). Finally, (IC.26I ) is just the tower property, Er[E[Xf |T]] = E[X 2 ]. ■ 
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